...and we went Nov 1 - 8 this year. New Jersey schools are typically off for Election Day and that Thursday and Friday of the same week for Teacher In-Service (Convention in Atlantic City).
We were there (4 adults, 6 kids ages 1-7). We never needed a fast-pass and the longest line we waited in was 30 minutes for Kilimanjaro Safari. We literally walked onto Mission: Space, Journey to the Imagination, Snow White, the Carousel, Mickey's Philharmagic, Tiki Room, Aladin's Magic Carpets, Lion King Show, and a few others I can't think of right now. The average wait for us was approximately 10 minutes. Not bad, in my opinion.
Also, while waiting for the boat to take us back to VWL, a CM apologized for the boats, that their timing was off. I told him no problem, the kids were behaving and I was in Disney. He went on to say that the attendance levels were high for that time of year. I asked what "high" was? He said normally 14,000 for that Monday (11/3), but that they were close to 24,000. It didn't feel like 24,000 to me that day. And I felt we waited very little time in line.
Also, transportation was great that week. We rarely waited for anything - bus, boat, or monorail.
Go ahead and try Jersey Week. The weather was fantastic (mid 80s during the day, low 70s at night).
Best of luck whatever you decide and have a great trip!