Yes, the same thing happened to me/us.
We were in DHS in October. The night before, we were at Busch Gardens Howl-o-Scream. So not only did we close the place down at 2 a.m., but we also then had an hour long car ride back to the hotel. SO no one was deceiving ourselves that we would be up early the next day. We slept in, and my sister and I got to DHS at around 11. Fast passes were gone and if I remember correctly the wait times were like 90-120 minutes all day. This when we hadn't waited in ANY line longer than 20 minutes for our entire trip (and, as it turned out, would not). When we got into the park someone gave us their Dream fastpasses, which had tickets for every attraction still intact EXCEPT Toy Story Mania.
If it was a ride I was seriously interested in, maybe I would have waited. But the concept was not too thrilling to me. Living in Florida I knew it wasn't the last time I will ever get a chance to ride it either. Even starting at the time that we did, we were able to do pretty much EVERYTHING ELSE in the park, including a walk-in lunch at Sci-Fi Diner, and riding Rock n' Rollercoaster twice, and sitting in amazing seats for Fantasmic!. So I wasn't unhappy with our day at all.
Next time we go I will ride it, and let you know if there is anything earth-shattering, ground-breakingly wonderful about it.