I have to wonder whether the people making those remarks to you have never been to WDW. Anybody who would make those kinds of comments or roll their eyes either has never been to WDW or visited there but never really felt the magic, in which case, I feel sorry for them because they have really missed out!
My DH and I don't have kids so every trip to WDW is an adults only trip, just the two of us. For us a trip to WDW means spending a week in a beautiful themed hotel inside the Disney "cocoon" (as someone else on these boards once described it -- I love that description!) with good weather, good food, good service, lots to do and plenty of opportunities to kick back and relax. What's not to like?
Happy anniversary! I hope you have a wonderful time at AKL! Your plans for dinner on the balcony sound wonderful! (Have any of those people who were rolling their eyes at you ever had dinner with a giraffe? I'll bet not!)