AKL would be very nice. The only drawback would be having to take the bus everywhere. Ask for a room on the Zebra Trail, that way with a little one you are on the side of the building with the snack shop and pool. If you can afford the upgrade, a savanah view would be nice for the little one to watch the animals.
For the Swan/Dolphin, I have not stayed at either one, but I have stayed at the Boardwalk Inn. It's nice being able to take the boat to EPCOT and MGM, but you probably will not be going to those two parks as much as MK and AK with a 3 year old, so you would have to take the bus anyway to MK and AK from those resorts.
I have not stayed at the All Stars, so I can't comment on that one. I think you would enjoy the theming and animals at AK, and like I said, a room on the Zebra Trail would be the most convenient for pool and snacks. I've always found the snack bars to have a good choice of food at the deluxe resorts.