I also think you should go for it! However, I would check to see what the school policy is first. My kids are in Kindergarten and first grade and I was required to put our vacation plans in writing to the principal of the school. He encourages family time and as long as the kids are doing well in school, the trip is not a problem. He wrote "approved" on the note and gave a copy to the two teachers. Now it's up to me to remind the teachers of our trip and to make sure the kids do any assignments the teachers gives while we're away.
Last year we took our daughter out of kindergarten for a few days and the work she had to do was very simple. Practicing her name, circling things that start with L and practicing patterns. If you know what the teacher is teaching that week, it's very simple for you to introduce it to your child and help reinforce it. Disney is 12 hours away for us so that's going to give us LOTS of time during the drive to do some work!