We did this once. The cms (waitstaff) didn't rush us, but the cm (chefs) did. They were trying to clean up and so things were taken away quickly. If you can fill your plates, you'd be able to sit and eat. The character interaction is almost non-existent. They will see you once, but then they are all over the place getting ready for their shift to end too.
If you can go with the flow, it may work for you. But if you like a "traditional" character meal, such a late time might not bring the Dmagic your way.