My in-laws live in OC, so we frequent it alot. My in-laws family actually own the Francis Scott Key in West Ocean City. It's not on the beach, but it's a very nice hotel and very affordable, and I believe they have rooms that sleep up to 8. They also have a indoor waterpark, which my daughter just loves. Okay, enough about my bias toward family.
On the beach end of town, we've stayed at the Grant Hotel, Comfort Inn Gold Coast (which is currently undergoing a rehab), Quality Inn on 57th, Crystal Beach, Howard Johnson on 12th, and I'm sure many more that I can't think of. Plus we camp there alot. I can't really say that I've ever had a bad trip (except many many years ago, and that hotel isn't even there anymore). I hear that the Hilton is very very nice, but too pricey for my wallet. The bad thing is that everything is way overpriced in the summer. Sorry, I'm not spending $400 a night to stay on the beach.
Can't really help with Rehoboth. We've only stayed their once and it was in Comfort Inn on the highway near the outlets. It was nice though.
Have Fun!