Since you’re going to all of the theme parks, it sounds like a pretty even trade transportation wise. The stroller has to be folded for the drive to any of the theme parks, so that doesn’t seem like it’s a real consideration (it would have to be folded twice in situations where you need the tram). I can see not wanting to wrangle children on a bus, and that being a tipping point for driving.
I just cannot see changing the resort for this reason. Compounding reasons, sure, but not this reason alone. The Minivan, as has been mentioned, could be worth it if you are still maintaining a decent savings vs. just switching to the CR.