I agree that Crystal Palace is pretty loud/crazy. We like the food, but the character interaction isn't as good as Liberty Tree Tavern (dinner) and I think the open layout makes the place loud. But we still like it, just not our absolute favorite.
IMHO, if you're looking for a quiet lunch, go to CP for breakfast or dinner (LTT is nice for lunch, no characters at lunch, but GREAT food and pretty quiet, other counter service restaurants are good, too). If you really want peace and quiet, hop the monorail to a resort. (Maybe the Kona Cafe at Poly) Resorts are quiet at lunchtime and after a full belly, the monorail ride (or boat)puts most kids to sleep.
Also, I made late breakfast reservations for CP in early December and the CM mentioned that the characters change to Minnie and Friends for lunch and dinner. Now, I KNOW we've had dinner there before with the pooh crew, so I don't know if that comment is correct or if it is for selected days, but you may want to double check on that if you want to see Pooh and friends.