We've done it three different ways on different cruises -- sat for two dinners, take kids to the buffet before we go to Palo, and, on our recent cruise, sent the kids to dinner by themselves and headed off to Palo just the two of us.
Obviously, the kids have to be old enough and mature...