There are lots of things to do in Celebration, and NONE of the stores carry Disney merchandise (disney does have a liquidation sale 2x per year, held at the school gym) You can take a Segway tour of the town. Have a nice meal, take a horse drawn carriage ride, rent a paddle boat, sit by the lake. If you're coming in November you can watch the snow fall.
From I-4 take exit 62. From "on" property, follow the signs to the Magic Kingdom, when you get to World Drive, take a left (away from the MK) which dead ends in Celebration.
Enjoy!