I've been in mid-May and the crowds have been very manageable (after Mother's Day but before Memorial Day). Several days FastPass was closed -- it wasn't needed due to practically no lines. If there was a line, the wait was very short. We love the Flower & Garden Festival at Epcot. It's a great time to go.