In my experience, May through early June are much lighter in attendance. We went Memorial Day weekend this year, only did HS after hours and Disney Springs. It was busy but, not packed. For example, when getting snacks and lunch, no significant waits. We were able to get dining reservations at Boma and Ohana even after the 60 day mark. It looks like summers are lighter overall as well.