We are going Nov 18th-22, and did the same thing 2 years ago. The crowds were fine during the week - we hardly had to wait at all. Friday is the first official day of the holiday celebration, and they will have the parade, Fantasmic etc - it will be much more crowded that day I am sure. You should still have fun!!!