I think it depends on when they need to go back for naps as well. We always do our CS lunch around 11:30 am (for breakfast, we use a snack credit to get a muffin, bagel, danish, etc) since the restaurants open then and are not yet crowded.
We then head back to the resort after that for the afternoon to either swim or just relax (no toddlers left in our group!).
So, if you plan your lunches at the times prior to needing to take the little ones back, you will have the flexibility to eat at other CS places, either in the parks or at some of the other resorts near the VWL. We ate a few times over at the CR in the Contempo Cafe. We did early morning at MK, left around 11:30 am, walked over to CR, ate lunch, and then took the boat from CR back to VWL. By 1:00 pm, we were back at the resort swimming.
Good luck!