I think that in your case any potential monetary savings would be greatly offset by your dislike of the car travel and loss of vacation time. So disregard the savings and fly.
We have driven on our last 2 trips to WDW. But we are retired, so we actually can (and do) consider it as a part of the vacation. We even take an extra day on the way down and 3-4 extra days on the way back (it's like a second vacation after WDW). And we don't count milage and wear and tear on the car. We are going to drive the car into the ground in a few years anyway, so what's an extra thousand miles or two now instead of over the next couple of years?). Gas is cheaper in many states. So is food. And we usually stay in hotels using affinity points (so 0 cost).
We actually do enjoy the scenery from the interstate. And mentally file away places that we want to go back to see more thoroughly at a later time (planning a 'civil war tour' in the near future). So it doesn't have to be boring.
But some folks absolutely, positively have to get there ASAP. I can understand that. Different strokes....yadda yadda yadda.

So fly for now, and save the driving for sometime in the future.