In early november you still run the risk of hurricane season. We were melting in St. Maarten. In St. T, I don't remember it being as bad but it rained briefly, which felt good. The port was rainy and chilly the day before the cruise. CC was beautiful, the water was beautiful, life was beautiful.
Clothes wise, I'd pack a sweater or a light jacket but you may be colder in the air conditioning than outside. I wouldn't worry about long pants unless you're spending time at WDW when the possibility of a cool night does exist in November.