I think some of the common threads to not caring about riding the rides are:
1. Live close enough to drive
2. Travel without kids
3. Have APs and visit the parks frequently (related to #1)
1. We drive, but we're in the "2,000 mile plus round trip" club.

2. We have five kids, and so far always have all five with us for our Orlando trips.
3. We get to Orlando only every other year, and we don't do the Disney parks every time.
I think it's got less to do with family or distance and a more to do with personal style. I hate amusement parks and think a day of only rides is deadly dull. Some of my kids wouldn't ride
anything the first time if I didn't insist, and others view the thrill rides as something to be endured so they can say they did it.

Even the kids who love the rides, also love other stuff at Disney we can't do or see anywhere else -- the Sorcerer's game, for instance, and we don't go anywhere else with someone like the acrobat in France or street theater of the quality of the Citizens of Hollywood.
So of course we're not going to worry about doing all the rides at Disney. But neither do we feel like we're wasting our money. In one sense, I don't understand the people who spend so much time on all the rides at Disney that are basically carnival rides or coasters, when those are so much cheaper (and the coasters more exciting) elsewhere.

What Disney does best is the theming, the atmosphere, but those rides are not where the theming is done the best, if you see what I mean.
OTOH, we are carousel fiends, so of course we ride the carousel at the Magic Kingdom. In that sense, I totally get people who love coasters and carnival rides riding the coasters and carnival rides at WDW. And I get it when ride mavens say WDW is a waste of money, because I think it's a waste of money to go to WDW and just ride the rides.

But I also get that some ride mavens love the theming, so Disney gives them something other parks don't -- for them, it makes financial sense. But I really don't think that's Disney's entire, or even main, audience. I suspect that most people like to relax on vacation.