I'm honestly not a big fan. The time I went, I just felt the seafood selections were just terrible (in terms of taste, not what was offered). Granted, I'm a bit of a New England snob when it comes to seafood, but I was just very disappointed.
That being said, while I let that one experience taint the entire Cape May experience (i.e., I've never been back and don't plan on it)... I do have many family members and friends who absolutely LOVE Cape May, and have been there on numerous occasions.
If you're not short on time and you're not opting for Cape May at the expense of some other fine establishment, I say give it a whirl. Hopefully you'll have an experience more on par with my friends and family than with myself.