I wouldn't say with or without kids is more or less hectic. True, whenever you add more folks in to the mix, it does add different preferences...but I've had more clashes with the adults in the group than the kids. We're still the same psycho commandos no matter!
On all trips, we like to see almost everything once. I regularly skip a few things like TS Island, and the Snooze of Presidents - maybe see those on the last day for variety. I always make room for my childhood favorites though- Haunted Mansion, IaSW.
With no kids, we'll ride Space Mtn. more times. With kids in our group, we'll spread out the fastpasse smore evenly - maybe a little more Pooh and Pan, but still hit the biggies.
The kids in our family are really cool though and like to be on the go at WDW. No matter who is in our group, we tend to do the extreme hours - early am and late pm. As I said above, it's not the kids who are usually the problem- it's some of the adults who have been whiners.
Also, I don't mind a few drinks, but it REALLY made me mad when a certain adult had to get drunk every night we were at WDW. (He had a HUGE bottle of vodka in his room - every time he was there he'd have a big glass, and he'd bring some for the bus ride to dinner, then have more with dinner, ...UGH!
) I REALLY felt sorry for his kids.
Personally, on a trip to WDW , I prefer to have the kids - they add magic!
I'm betting this isn't what you meant....but I don't do any more sitting without the kids. We are often in a goup with at least three adults - maybe more - so child swap isn't so much of an issue. T slows you down a bit, but ou also get ro ride things multiple times (depending).