I haven’t had breakfast at Cape May, but I was really disappointed with our GG breakfast. Dry, dry, dry over cooked eggs (both with our first platter and the refill), weird tasting sausage and over cooked tater tots...though the sweet rolls were good. However, most WDW buffets I’ve been to are hit or miss (some great food, some not so much). Given my experience, I’d chose breakfast based on the characters I wanted to meet, not the food!
Edited to add: I reread your post and see characters aren’t your thing. In that case, you could also try Ale and Compass breakfast at YC. In general, I think most TS places with characters have more hit or miss meals than TS restaurants without characters.