Also, if you do go just for dessert, make sure to tip well. CMs have to work just as hard for all tables, and I've read reports of guests either stiffing the server ("Well, we hardly ate anything!") or trying to tip as minimally as possible. My CM friends say that this makes things hard for them.