Like you, we are not constantly going to the parks, and we actually build time into our Vacation to relax. We have stayed in Congress Park and Paddock Area and like both. Our daughter loves the pool in the paddock area, and it is just a quick walk across the bridge to get to the main pool if that is your preference. We like the quiet pool at Congress park as well.
Of course being so close to DTD, it is always an option to go over to get a quick bite to eat (Earl of Sandwich here we come!), or to take a stroll in the evening. I am looking forward to the changes to DTD, I am trying to find information on Disney Springs, and have seen some of the conceptual drawings. I am sure it will be done well.
My wife is a runner, so she jogs around the resort and over to DTD in the mornings, and I get to play golf, so you cant beat having LBV golf course right there.
The more we go, the more we find things outside the parks to do. I am amazed at the things we find. Last year we spent a half day over at Fort Wilderness just walking around, seeing how they care for the horses, and walking the nature trail between Fort Wilderness and the Wilderness Lodge.
SSR is a great resort to kick back, and there are plenty of quiet areas if you need to get away from the crowds for awhile.