I suggest that you make a day of going to one of the water parks. There are lots of water parks here in Orlando, check out groupon, or the websites for discount. I know that Sea World normally has some kind of deal going that includes Sea World and their water park.
A couple of times, when my DD was little, another friend with kids and I would go half on a room for 1 night, check in early use the pool, and hang out and go over to DTD for the evening and swim on Sunday then head home later in the day, it was like a mini vacation for 2 single moms on a tight budget.
I look at it this way, when you are staying and paying at the resort how would you feel, if you knew that a group was using the pool, towels, chairs, etc. and they did not pay to use it, and your family could not find a spot to enjoy the pool that they paid for? Trust me I would not be to happy about it.