I, too, prefer Congress Park and it's a good section because it's just a five to ten minute walk to the Marketplace section of Downtown Disney. The pool area there isn't as busy (or noisy) as the Springs pool area or the one at the Grandstands.
I think that the buildings (rooms 9101-9436, 9501-9836) that are a bit away from the Grandstands pool would be good, too. This section has quick access to the Westside of DTD. The Paddocks section runs along the outside of the resort (but buffered from the road outside of the resort) between Congress Park and the resort entry security booth. There's a small pool area in that section but there are a couple of buildings that are closer to CP's pool.
I think that, based on what you indicated in your post, any of these areas would work well for you.
Dick Taylor