We went that week for my sister's wedding in WDW in 2003. It was fabulous. Hands down, the best time we have ever gone and we have done March, April, May, June, August, September, and October. We arrived the Saturday after Thanksgiving and stayed through Friday with my sister's wedding on Wednesday. Weather was beautiful - sunny, and 75 - 80 every day. Needed a light jacket or sweatshirt in the morning and evenings. We didn't swim because we were just so busy with the wedding, but you definately could have in the afternoons. Crowds were low, all the decorations were up, and we did Mickey's Very Merry Xmas Party in shorts and t-shirts.
We would go that week again in a heartbeat.