My DH and I did this a couple of times at the table service restaurants. We were often way too full to eat dessert right then, but would take it back to the room and eat it later.
I don't think you would have any problem doing this....we didn't!
Happy Eating!