If you have your own car it won't be a problem at all. If you're taking Disney transportation you should be fine with that much time, but it could turn into a nightmare. Of course if you find you are running short of time when you are finished with dinner you could always take a cab.
Melissa