As mentioned, you can absolutely go and visit, and it is great fun, especially for the kids at night. In the evening, you can walk the boardwalk as mentioned and enjoy the buskers. We ordered a pizza from the pizza window at Shutters (alas, no longer there!) then walked over to Yacht Club to check out all the hype. Both are lovely resorts!
Come prepared though. If you head over to Yacht Club at night, they have a campfire set up and you can purchase smores packages with marshmallows you can roast over the fire on long skewers. We asked if we could participate (with the pool-hopping rules, we wanted to be sure we weren't overstepping) and they were very welcoming.
Afterwards, they showed a movie on the beach on a big, blown-up screen. My kids were killing to stay but all the loungers set up for this purpose were taken and we didn't bring anything to sit on. I'd suggest bringing a blanket, sheet or towel along and enjoying the movie, then Illuminations fireworks from the beach. We had an absolutely lovely night last year.