In 2003 we went the first full week of November. Daytime temps ran 80-85 daily. It was still somewhat humid. We wore shorts everyday and swam quite a bit. The biggest thing that stood out to me was that it was never sunny on that trip. It was overcast pretty much everyday- we did see 2 full days of rain.
The evenings were considerably cooler though. At night we didn't swim. We had to wear pants and sweatshirts at night. It was usually in the low to mid 50's.