The end of April through he first couple weeks of May is my favorite time to go!
Crowds are reasonable. I tend to notice a higher percentage of young kids and strollers than I do at other times of year. I also think character lines are generally longer (probably because of more young kids). But, of course, as on any observational-type thing, YMMV.