My opinion is no I would not. I would not go on any trip without my children. I haven't been away from DD3 ever and only 1 night for DS5 which was the night DD3 was born. I had children to enjoy every moment with them and to experience things through their eyes. We go on many adventures big and small and each one of them have made wonderful memories that they talk about constantly. Of course when they were younger traveling wasn't always easy but that adds to the adventure (like the time our flight was cancelled and we drove 27 hours straight to get to the port for a cruise that was leaving with or without us, or the time taxing out on the runway a quiet plane erupts in laughter because my then 3 year old shouted that he had to go #2). They are at an age now where they understand the expectations are to have fun, be safe, and listen, and if they can't do that then we leave. I couldn't imagine going on a trip without them I would miss them too much. I would feel very guilty them knowing I was at Disney (or anywhere) without them. We all go or we don't go at all. I also think about if I was away without them and something happened how I would never forgive myself for not being available. Of course this is a long shot but you just never know. As far as time with just my husband, we don't need that. We don't need a week away from the life we created together to reconnect. That seems more like a nightmare than bringing toddlers to Disney. If you think they are too young to go and would somehow ruin the trip you should probably hold off. I am waiting for my kiddos to get older to revisit places DH and I went before they were born so they can appreciate them more and experience them fully (like Alaska for example).
I'm not trying to guilt you into a decision, and I know lots of people who do go on vacation without their kids. This is just my opinion since you asked. I am curious though why you think taking them would be a nightmare. Do you feel they are not well behaved enough, and if so can you practice with shorter adventures to say the zoo or local amusement park? Kids have meltdowns at Disney all the time. It's probably one of the few places where is totally normal and no one bats an eye. It's how you handle it that would set the mood for the trip.