Labor Day weekends cause us major nightmares, but that's just unlucky for us. Last 2 trips we did over Labor Day, we were impacted by hurricanes! The good news for you is that WE won't be there over Labor Day anytime soon, so you should be fine with the weather!!
Agree with piglet1979 - seems like later in August into early September might be the only slightly down times you can count on anymore..... even post-pandemic.