There is no clear cut answer to the question of whether to swim now, as you no doubt know.
One thing is sure, the temperature of the air now, except for certain parts of the day, is much less than the swimming pool water.
Maybe one indication is that Typhoon Lagoon and Blizzard Beach have been closed during the cold spell. But, this may not help.