The Christmas decorations are not up at EPCOT until after F&W, but we were there Nov 4- 10 last year and everywhere else was very festive! The castle lights and Jingle Cruise debuted on Nov 4 at MK, Goofy Santa was out at DHS, and AK was up as well! The Christmas parties start then!
As for crowds - well, it's hard to say but with Election Day on the 8th and Veterans Day on the 11th - there are many more kids besides those in Jersey that are likely to be there that week with few school days to miss. Will it be 'tooooo crowded'?? Probably not - but it likely won't be empty.
Utilize Rope Drop and Late Nights and a good touring plan and you will be fine. Not to be a jinx but you have a great shot at very pleasant weather at that time!