Originally posted by lentesta
Hi Madi100,
It's a bit different for restaurants and attractions. And I don't work on the restaurant reviews (we've got culinary professionals), so this is just my understanding of how that part works.
We have several team members visiting the WDW restaurants throughout the year. And we get literally thousands of guest responses back per year on the restaurants, too. We try to spot trends, both positive and negative, in both the meals themselves and the surveys throughout the year.
I believe for the 2005 edition, a restaurant with a reader satisfaction swing of more than 10% either way got special attention in the form of more-than-usual visits. Obviously, restaurants undergoing chef, menu or theme changes also get looked at more closely than usual.
For restaurants, I think there are very few examples where our ranking differs significantly from reader satisfaction. In fact, I can't think of any at the moment. For those restaurants we don't recommend (Cap'n Jacks, I think, is on), way more than half of our readers probably also agree. While it's possible to have a decent meal there, the odds aren't in favor of it.
For attractions, it's the subjective opinion of the reviewers. I'm pretty sure Bob does the actual writing of the reviews, but he's solicited input from probably a dozen researchers on any particular attraction. For Mickey's PhilharMagic, for example (four stars, not to be missed), I know my team alone sat through the film between one and two dozen times.
Besides forming our own opinions, we also observe how other guests, particularly young children, do on an attraction. Roughly one-third to one-half of the kids we watched in Goofy's Country Dancin' Jamboree, for example, were frightened by the loud music, lights, and characters. A signifcant number end up leaving early. That also goes into the review. (And for what it's worth, I'm pretty sure I've seen that show enough times to be Sarah Jo's understudy.)
Hope this helps. Let me know if there's anything else I can help with.
Len