You might want to ask this question on the resort board. Even though the Swan is not a Disney resort it is lumped in with them since it is right there on property.
I have stayed at the Swan (it's very nice - you should enjoy your stay). My one tip is to not valet park. It is double the price of valet at a Disney resort and the self park lot is right there in front of the hotel.
As for club level, in a lot the the posts that I remember people, for the most part, do not seem to have been too impressed - more people seem to like the WDW resorts concierge level. If I remember right, one main gripe was that the lounge was not open long enough.
I am not a big advocate of concierge level anyway for the very reasons you mention though many people insist that concierge (at WDW resorts) is the only way to go. We were once upgraded for free to concierge level at the YC. We essentially used it for breakfast (cereal and coffee/tea) and evening dessert and nightcap. This was great to have and we certainly appreciated the upgrade, but I would not have paid a whole lot extra for this. We found the CM's at WDW dining to be more helpful in making ps's than the concierge so the "service " part of concierge level was not worth any money IMO.
I have to say though that meals and snacks for a family of 5 can add up pretty quickly so if you really stick to the fair offered at the Swan club level you might come out ahead. But you do have to remember a couple of things:
1) When you eat at club level there is what there is and if there is nothing there that really strikes your fancy you are going to feel obliged to eat something you don't really want because you've already paid for it.
2) You may feel obliged to deny yourselves a snack or meal that you really would like while you are out touring the parks just because later you will be going back to the hotel where you can get "free" food.
HTH with your decision. Again, go look on the resort board, you'll get more opinions there.
