We've done both -- for breakfast and dinner. We too, love Cape May. I hate buffets, but I'm always happy here (and at Boma). For me, Chef Mickey's is always loud and as someone else said, chaotic, the food always seems cold and the service is always only so-so. Cape May usually seems more relaxed, the food is always hot and delicious and the service has never been less than spectacular. As for character interaction -- obviously, you only get that at breakfast at Cape May -- but you definitely got more time and attention at Cape May than at Chef Mickey's.
For a great character meal with GREAT family style food, try O'hana for breakfast! We LOVED it! The food was simple, but fantastic, the service was wonderful, and Pluto and Stitch were the best I've seen (Mickey and Lilo were OK, but they're really second to the zaniness -- sp??? -- of their partners in crime). The best character breakfast I've ever had!