I can tell you what it was like the first weekend of June - which wasn't an overly crowded time in the park. We arrived right after 8:00 for early entry. My kids rode FJ, and the 2 roller coasters in HP land before 9:00. They had done Ollivander's the night before (right before closing), with only a 15 minute wait. I would guess that the wait for Ollivanders during early entry was way over an hour - the line was huge.
As we were leaving HP world, going over the bridge to Jurassic Park, (right at 9:00), you could see the line for FJ. It was so long, they had set up queues on the bridge to JP. I don't know if all the queues inside the castle were full or not, but there were lots and lots of people in line outside.