Yes, you are crazy to not go there. WDW is a TRAVELING vacation. Lots of walking, lots of moving around. And something about it makes everyone want to plan on going somewhere to do something. To not take advantage of Boma, which is an excellent buffet, a restaurant located on your property is to lose the opportunity to have a more relaxed plan for a least one meal.
Breakfast there is excellent, with few non-American choices. Dinner was also excellent, with plenty of choices, espcially if you don't get caught in the "buffet" mentality. You could have a very nice meal there from the carving board, the salad board/soup, a nice side dish and dessert and still get your money's worth without having to eat yourself silly.