Turf Club at Saratoga Springs is wonderful! It would be easy for you & your husband to head to DTD for awhile afterwards too if you wanted to.
We also really enjoyed Captain's Grille.
I haven't been there yet, but The Wave might be a good, romantic place. Plus, it would be nice for the grandparents to take the kids to Chef Mickey's and then meet up to go to the MK.