I'm sorry your server was rude, no excuses for that. However, I agree that if your set expectations that menus will be adjusted or that your children will be fussed over, you already have set your experience up for disappointment. I think folks already have high expectations for a castle meal, when in fact it is basically a character meal in a pretty restaurant, so if you inflate that, well... It's going to fall flat.
Op- you can't go back and change your experiences, but you can avoid that kind of thing moving forward. When you have character meals make sure you go in with your camera ready. If you are rushed or you miss a character for whatever reason, tell the server. Know that cost of these meals is not equal to the foid quality, you pay for the characters, and remember that most servers try very hard to give your family an experience that is magical, but there are times when they cannot control the chaos Aron's them. It looks like you got stuck in that kind of circle. I avoid breakfast in the MK because it seems they are pushed to move families in and out. The servers cannot hide that sense of urgency, I think. I prefer dinner or the resorts for character meals, although I must say that Akershus in Epcot has never let us down.