I've done both.
Early Dec: lower crowds, more xmas decorations, better discounts, weather can get downright cold some evenings
Early Nov: busier, food and wine festival, you see both fall and early Christmas decorations, weather is generally warmer
I am a huge food and wine festival fan so I prefer early November. My son loves the pool so having it be warmer is a nice bonus. You can get around the crowds with a good touring plan.