Crowds the first week of May are pretty light. Epcot tends to be crowded on Mother's Day due to the Flower and Garden Festival plus the Mother's Day Brunch at the World Showplace.
We were there that week last year. Crowds weren't too bad, with the exception of MGM during Star Wars Weekends. I've been there with them a bit lighter in November. The heat was the real killer!