My Wife and I have always wanted to try that. We love the parks, but really love the whole resort environment. Off the top of my head, here are some things we'd do if we wanted a non-park Disney Vacation (and had an unlimited budget

)
1. EAT EAT EAT - a different table service resteraunt every night
2. Mini Golf
3. Downtown Disney - Circue de Sole, shopping and more dining
4. Horseback Riding at Wilderness Campgrounds
5. Luau at Polynesian
6. Hoop de Doo Revue at Wilderness Lodge
7. Yee-Ha Bob - at Port Orleans
8. Illuminations Cruise
9. Speed Boat rides
10. Grand Floridian Orchestra in the lobby and order tea
11. Character meals in several resorts
12. Camp fire Sing Alongs
13. Movie night under the stars in many different resorts
14. Bike riding/Surrey bike riding
15. Catch the latest Disney flick at AMC
16. Jelly Rolls
17. Adventurer's Club (Oops - forgot

)
18.Hang at the Boardwalk during the evenings
19. Go for early morning walks around the different resorts
That's just off the top of my head, and I didn't even mention the obvious "hang at the pool", nor have I even left the grounds yet.
I wish you luck on your non-park Disney trip