We got stuck with a 4:30 time last time we went because that was the only time available and we really wanted to try it out. By the time we sat down, ordered and got our food, it was around 5:00. We ate slowly, so it didn't feel so bad. Doesn't hurt that it's dark in there, so it felt like it should be dinnertime. We also didn't eat anything big for lunch, so we were pretty hungry and the time of day didn't matter at that point.
After dinner, we just shopped next door and hung out in that area, rode pirates, etc. As for the show, we went 10-15 minutes before they said just because we were in the area and didn't want to stray too far. I was glad we did, there was a decent line and we ended up getting a rail spot, but that was before the BB and RBT areas were combined, not sure if that will make a difference.