This exactly! My kids are more into breakfast, and my husband and I prefer the lunch/dinner options, so we make a 10:20 ADR (that way even if we have to wait half an hour to get in, we should still at least hit the tail end of breakfast for the kiddos) to hit the cross-over to lunch at 11:00. The kids go heavy on their first trip to the buffet, and the adults mainly hold out for lunch. Get a plate of fruit from the breakfast selections for an appetizer and then pig out once they start putting the lunch dishes out!
We (adults) end up spending most of our time early on in our seating helping the kids with their plates anyway. By the time we're ready to serve ourselves, it's not long until lunch already. It works out perfectly!