My fiancee and I do this frequently. We like to be at Disney for certain holidays, (New Year's Eve, July 4th, Easter) but we prefer to avoid the crowds in the parks. If we do go to a park, it's just for dinner. This is our favorite part of being Florida residents!
When we do this we stay at one of the Boardwalk resorts. You're close to Epcot and MGM, and can also find things to do without going into a park. Frankly, we usually stay at the Swan or Dolphin, because I can get a teachers rate there, which is much cheaper than holiday rates at Disney hotels!