I would ask a few more questions, and try to find out what the two kids object to, and what the big attraction of Vermont is. (Smuggler's Notch? We live 15 miles from the VT border, and aside from that, I'm drawing a blank!)
I also have 4 kids, and I try very hard on every vacation to take everyone's needs/wants into account. Not that everyone is going to be ecstatic every second, but I liek to have something that's super appealing for each child. For example, we spent a few nights at Great Wolf Lodge this summer. For DD17, she and I took a trip to the outlet mall. For DS15, we found a nearby rifle range, where he and DH got to try a number of rifles. DD9 was perfectly content at the waterpark and making a stuffed wolf. The highlight for DS6 was a day trip to the Crayola Factory. And the waterpark.
Similarly, when we go to WDW as a herd, we stay offsite--my kids prefer it. They like the room, they like my cooking, they like the private pool. We schedule plenty of down time, so they can watch movies or (DS15's favorite) play videogames in his own room with his own TV. We do Universal, Seaworld, and Gatorland. we stay for 2 weeks, but only go every other year.
DS15 has a chance to go to WDW as a class trip in the spring, and he doesn't want to go. He likes our family WDW vacations, and doesn't want to do the All-Stars and park blitz that he figures this trip will be. Along the same lines, I'm going down in Jan., with just my younger two kids. It'll be a different vacation, we'll stay onsite and jsut do WDW.
I should add that because of my family's size and age ranges, vacations require about as much planning as the invasion of Pearl Harbor.