I travel without my husband a lot, partly because he doesn't love to travel the way I do and partly because he has less time available to take. We're both okay with that now but getting there took time because DH doesn't value travel as highly as I do and sometimes saw it as me "wasting money", and I didn't like traveling without him as much when it involved wrangling three kids solo. Now that the youngest is 9, I'll happily take off with any or all of the kids in any combination and there's no stress to it, but when it was a toddler and two tweens... Yikes!
I do wish my husband was more open to travel. There are a lot of adventures we used to talk about when we were younger that he's since decided are too much for whatever reason - too long a drive, too long a flight (he hates the idea of trans-oceanic flights), too foreign, too much time away from home, etc. I suspect when the kids are no longer at home and asking him to come along, he'll become even more resistant. It isn't a deal-breaker because he doesn't want me to stay home to humor his preferences and I don't plan to let it stop me from going places, but I would prefer if I could share those trips with him.