In my experience, swimwear can be worn in the buffet for breakfast and lunch as long as you have a coverup on over it.
Personally, I wouldn't wear a swimsuit (even with a coverup) in the MDR for any meal. I would be worried about getting the chairs wet, or stained with sunscreen, as the chairs there are cloth covered.