OP, I'm not sure how helpful this thread is, with near-equal parts "I love it" and "I wouldn't stay there again," but here goes.
I wouldn't stay there again. I stayed at the Swan once, after having stayed onsite at different Disney resorts several times. I was hugely disappointed in the Swan for a number of reasons, and the first day that I was there, I called the WDW resort line and got a room at AKL for the following day. I would've switched that day, but nothing was available.
Why did I not like the Swan?
First of all, there's no theming there. I'm not talking about in-your-face Disney characters, I'm talking about the overall theming that, to me, makes the WDW resorts so wonderful. The theme at the Swan could be described as "pretty nice hotel anywhere in America." I didn't feel like I was at WDW, even though I could walk to Epcot and DHS. I could've been in the middle of Iowa (no offense to Iowa meant).
The room I had was loud--it was right next to a mechanism on the roof--maybe a generator?--and it was impossible to get away from the noise. I probably would've lived with this had everything else been to my liking, but it wasn't. In order to get a QS-style meal, I had to go over to the Dolphin and use their cafetaria-esque facilities, which I found lacking in a lot of different aspects. This was years ago, so that might've changed.
And, to top it all off, the bus service to the nonwalkable-to parks was awful.
I was happy to check out and go to AKL and more than happy to spend the extra bucks. I had an AP at the time and was able to get the AP rate at AKL, so the price wasn't anything like what it is now, but whatever it would've been, I would've paid it.
Many people, as you can tell from this thread, love the Swan/Dolphin. I am not among them but I understand why they like it. It has convenience, location, and good rates.
But, OP, if this is your first trip, do yourself a favor and stay at a WDW resort. Got the full-immersion experience. It's terrific.