I was at the Swan about a month ago when it was booked to capacity due to a convention.
Yes. I saw the people involved walking around the lobby area, in the hallways, and elevators quite a bit, but it didnt affect me at all. Once I started to feel a bit funny being in the elevator, surrounded by "suits" when I just returned from the pool. Then I thought, hey, they are the poor people that have to be here and work, Im having fun, what do I care what I look like.
During both my visits to the Swan, transportation has always been great. Never a long wait for a bus or boat. the only problem I had with the bus was on the last trip due to the convention, they had a ton of luggage out in the bus stop area. I went there to wait for a bus and soon saw one drive right by me. The bus stop had been changed to the other side of the entrance and they didnt have any signs noting that.
As for a quick breakfast I believe there is a little coffe stand in the lobby area that sells muffins, bagles and the like, however Ive never eaten there. Tubbies at the Dolphin is also good for a quick breakfast...and they have Krispy Kremes.

We like to take a stroll to the BW(a very quick walk), grab a bite at the bakery and eat out along the water.