My wife and I went once by ourselves on one trip. We then went again with my wife's sister and her husband. No kids both times. However, there are lots of kids but we still thoroughly enjoyed ourselves. We also noticed other adults only tables. We say go for it!
We also just returned from an adult only trip and went to Chef Micky's for breakfast we all enjoyed just watching all the children have a great time and thought about when ours were that smaal and how much fun they all had.