There has got to be a reason he doesn't like it.
For some, they think it's too expensive, some too tiring, some too crowded, some don't want to do the "park" thing everyday. It's different for everyone.
Now, if he just hates all things Disney, there's not much to do about that. I guess you'll have to go alone. But I would think for most people, there is a logical explanation to why "they don't want to go".
you know why I think that? Because, what parent, while seeing their children have the time of their lives and big smiles on their faces, would then say to those children that they themselves hate the place and don't ever want to come back? Instead, you might just need to make adjustments in the vacation.........like stay offsite in a pool home so they are more comfortable (this saves money also).....or don't do the parks everyday, plan something for them that they really enjoy, golf, massage, boating, etc.
I remember when I was a child and we were there and my dad was filming everything. He rode rides and such but you could tell he was getting more joy from watching us enjoy ourselves. I didn't get it. He loved WDW but it was all about us.
Fast forward 25 years, we're with our 3 children.............yep, I get it now. I absolutely love the place and fortunately DH does also, but WE got so much enjoyment watching our children......ok, I'll admit it, it made me teary eyed a few times.
But I do understand why people don't want to go every year, even every two/three years. But to say I will never go when I know the rest of my family loves it.............wow, I could just never do that, but that's ME. (I'm not talking to anyone on here, I'm just talking in general terms )
Personally, I almost like the beach better than WDW. I love WDW but it's not really vacation to me. I know some say not to kill yourselves, but at the beach you are not going to catch me up at 7am for a park opening.

I sleep in and lay on the beach or lay by the pool and go out to dinner. I don't walk 10 miles a day at a park.
So I get why some wouldn't like it. There are tons of great places to go with your family. I'm just saying there's got to be a reason why....the heat, expense, crowds, whatever.