It depends.
Cape May we definitely prefer the food at (and that's with us not even touching the seafood side!)
Chef Mickey's... not too fond of. Did Thanksgiving there last year, turkey and thanksgiving items were okay.... so that was what saved dinner from being terrible. If not Thanksgiving, then nope, wouldn't do dinner there at all.
What are your park plans? If one location fits into your plans better, then go with that.... such as if going to be in the MK area that day, and then if would like to have the characters, then definitely do CM. If dont' care about the characters and want a better meal and CMay is convenient to get to - then definitely go for that!