Well, I have visited the Swan to eat during a Garner (?) convention in October, and after working my way through the too-small suit-filled lobby and noticing a lap-pool closed for a convention party, I was wary of vacationing here.
However, DD and I joined DH at the Dolphin last Feb. while he attended a SANS conference. There were actually 2 or 3 large groups there that week. And while I noticed the business attire of many guests in the lobby, at the bar, and at the Boardwalk (during meals), it had no impact on our vacation experience. There was one evening where the staff was setting up for a poolside party, but the main pool was left to the guests (at least until sunset).
A plus to this was the aforementioned uncrowded buses. Everyone else is going to meetings and lucky-you are getting on an almost empty bus to the MK!!!

And at $185/night, I don't think the villas or deluxes can compete, really. (At least,
I'm at a loss to find a deluxe that makes the extra expense worth it for our 2007 trip). This is NOT a case of you-get-what-you-pay-for.
We did not eat at many of the hotel restaurants, so I can't speak to that.
Of course, DD was oblivious to the conventioneers (as was every other child we saw). And the Dolphin lobby is cavernous, so the business people were a mere blip there. Also, at least at the Dolphin, the meeting areas are quite removed from the other guest areas, so that part is a non-issue.
In short, if the price is right, I'll do it again before paying rack rate for another on-site hotel. Definitely.