I can't give an "objective" view on which one is better because I've only stayed at the Swan, but that is because I like the more intimate feel like everyone else has mentioned.
No matter how far you're room is from the elevator it's not a far walk at all.
The CM's at both hotels are just wonderful! So, wherever you decide to stay, I'm sure you'll be happy.