I agree with
@lotsohugginbear that the Poly is chaotic, and I have aged out of it. The whole pool/ marina/ main building area feels so busy to me. I much prefer the vibe at GF. I would definitely not choose Poly solely for its walk to TTC, personally. I would also throw out there that technically you could still walk to TTC from GF, as there is a great walkway from GF to Ploy, but of course it would add probably another ten minutes to that walk.
Realistically you can’t go wrong at either resort but for me, the chaos is aversive enough that it outweighs the things that I love about the Poly. My family still loves it there though.