All of our trips have been Oct.- Dec. and I rather stand elbow to elbow in 70 degree weather than 90 degree weather any time!
Really, November is a very nice time to go, it can be warm enough to swim, or down right chilly. So be prepared... November doesn't see much rain fall if I remember right, and the park hours are always shorter, but with smaller crowds (with a few exceptions ie. Jersey Week, Thanksgiving) you get things done much quicker. I don't think we'll ever go anyother time of year!