Every trip I've taken to WDW except the first one has been without DH. He hates it (but in all fairness he hates all theme parks, lines, crowds, heat, etc). I've been taking the kids on my own since they were little (they're now 15, 17, 20 & 24). Usually while we're there he goes on a fishing, kayaking, camping trip with his buddies (not my idea of a good time - but to each his own). Some trips my mother came with me and once my sister and her family came, but mostly its been me and the kids. We have a great time! (and I don't have to worry about whether or not he's having a good time, making my trip miserable). GO! Have a wonderful trip. In fact, the kids and I are going to Universal Studios the end of the month for spring break and DH is staying home (and we're all happy).
DH and I usually take a cruise or an all-inclusive resort vacation by ourselves at some point during the year too.