In the morning, if you’re planning on rope drop, in our experience it’s been very fast. Security lines were shorter and buses were lined up ready to go. This was at 7am. It’s nice because when you get dropped off on the harbor side of the esplanade, you walk right into the esplanade since you already went through security. I believe security is only at Toy Story lot until about 11am (someone correct me if I am wrong)
Depending on when you leave, it could take longer to get on a bus back to the Toy Story lot. Last time we just walked back to the Hilton because the lines for the Toy Story shuttles were long. (If was around 11pm I think). I know right after fireworks the line can be long too.