I'm looking at the 2nd week in November. We've gone to HH that week the past few years and thought maybe we could give VB a try this year (hope we aren't disappointed-- we love HH!).
You can get more detailed information from the National Weather Service Melbourne FL website. However average highs for the second week of November are about 80 degrees, and average lows are in the lower 60s. You are also a good month past the peak hurricane season, and precipitation is at one of its lowest points of the year.
Sounds pretty nice, on average, to me. Especially after sitting up here in upstate NY this March.