Jersey Week - it overlaps with the NJEA convention days that your kids will have off in early November. (Usually the first or second week. In 2017, it seems the dates are November 9th/10th.) We haven't been for "Jersey Week," but we've gone in late October/early November, and also gone later in November several times and I can tell you that November is typically pretty nice, weather-wise... but there are no guarantees. Our trip in late October/early November (2014), we had lovely weather, 60's at night, upper 70's/low 80's in the sunshine all day. The day we headed back north, the high reached over 90... as we were dressed for the 40 degree weather back home!
Tail end of November, we've seen highs in the 90's and lows in the 30's (on different trips), and everything between. Overall, I've seen the "average high" for the month of November listed on a few weather sites as 78, around with the average low at 60... obviously the earlier parts of the month are warmer, with cooler weather more likely towards the end of the month. So I think it depends on what your family considers "too cold" - based on your son's needs. The likelihood is that the weather will cooperate... but nobody can promise you that.
