How special? and what's the group make up?.
For an adult evening and if you don't mind paying I'd suggest The Flying Fish Cafe ( obviously liking fish is another consideration). This is a very nice upmarket restaurant with some wonderful seafood on offer. Spoodles is a nice place to eat, but I don't think it falls into the "special occassion" catagory nor do the other more than adiquate restaurants on BW.
Other than that I'd suggest looking at the hotels in the area.. If there are kids in your group and you enjoy buffet style I'd go for the Cape May Cafe's "Clam bake" evening in the Beach Club hotel., there are a lot of non seafood items on here and the food is very good. The other choice in the Yacht club would be the Yachtsman's steakhouse, like the FFC it's not cheap and maybe not the place to take kids.
At the Swan and Dolphin you could look at Palios for Italian, Dan Shula's for steaks and they have a first class "Mexican" style restaurant. This is a REALLY nice restaurant and I was very impressed with it. Taco's, burritos and nacho's it ain't, the food is very tasty, it's more classic cuisine with a Mexican twist, classily done with top class service.