Well, if I had a spare day and was staying at the Poly, I would hang out at the resort and swim, rent some boats, maybe resort hop the monorail resorts, and then maybe go to DTD (or Boardwalk) in the evening.
If you're going to pay the $$$ for the resort, you might as well enjoy it.