I've always liked going in May!
We're from the northeast, so May in Florida is comparable to what we'll get a couple months later up here. I usually bring a sweatshirt in case of a chilly night, but mostly it's shorts and T-shirt weather. (And I don't remember a bug problem, so I guess I got lucky there!) I'd expect temps in the 80s.