We usually go every year, but skipped it this year (to go to Disney instead!)
I have always stayed in the Crest... a little quieter.
Port Royal is hands down my favorite...really nice pool and feels like a real "hotel" instead of a jersey shore motel. The Adventurer is literally at the end of the boardwalk, so very close to everything. I can also recommend the Waikiki, Pier 6600, and the Pan American. I have stayed at all of them. Keep in mind NONE of them will have beach chairs, unbrellas, etfc. on the beach - you'll need to bring your own or rent on the beach (expensive), That being said, you don't want to stay too far off the beach if you're going to be dragging your beach stuff. And the beach is HUGE in the crest so it's a pretty long walk down to the water.
I've always felt safe on the boardwalk at night. My son is little, so of course we're mostly in kiddie-ride land and back at the hotel fairly early. Here's a link to some of the boardwalk info
www.moreyspiers.com and there's some hotel info in there too.
Feel free to PM me if you have any questions -
And don't forget, when you go there, you will be "DOWN THE SHORE", not "at the beach" - it's a Jersey thing!