If you're just hanging around the hotel (a no-park day, where you wouldn't be missing out on anything except wandering around at your hotel), then I'd go... my DH (then DBF) and I had tons of fun at the Poly sitting in a hammock watching- it was just nice to be outside looking at the stars and just hearing the subtle music from the hotel around us. We also had lots of fun exploring the Poly and GF, as well as walking by the wedding pavillion. We stayed until the fireworks at the MK too (it was Fantasy in the Sky back then...)
I agree with all the other posters though, it's not that big of a deal (unless you have itty-bitty kiddies [I remember thinking that it was the COOLEST thing ever when I was 4-5...]) but if you aren't doing anything else, go to the GF or the Poly to watch it (it starts over there first, I think) and just have fun exploring the hotels!