How about the Plaza Restaurant (not Plaza Pavillion)? They offer the same menu all day...very good sandwiches, salads and ice cream treats at decent prices.
Like Simba's Mom, we enjoy Liberty Tree Tavern for lunch. We also enjoy CRT...in fact, that one is a tradition for us. However, both of these spots close between lunch and dinner. I don't believe the Plaza Restaurant does. So I guess it depends at least partly on how late you want your late lunch to be.
Eat at the castle! It's a great afternoon break from the hustle and bustle. The pretzel rolls are great. Nothing is better than Major Domo's Pie, except maybe the prime rib. The desserts are beyond royal and the service is impeccible. We don't let a trip go by without lunch in the castle.
Lucy's Mom