Just to let you know the second weekend of November is Vetran's Day weekend. Most people get a day off around this weekend and many get two or three, like my kids. A lot of people will take advantage of this and get away for a long weekend. We did a couple years ago, and will also be there this year, Wed. - Sun.
It will be much busier because of this. Also, historically they have had Beer Fest - or some silly name like that on this weekend. This also adds to the crowds.
We go this time of year because we stay on site and with FOTL the waits are never a big deal. Also, it is usually just the weekend days that are crowded, the weekdays are very, very quiet.
I think you will be fine, but just wanted to let you know that the crowds will be higher than another weekend in November.