As always at the Polynesian, it depends where - what building - you are. From the buildings closest to the TTC, it's 4-8 just to get to the GCH. From the GCH itself, I'd say about 10 minutes at a leisurely stroll; you could shave off a few minutes if you had to.
IIRC, it's a nice path - takes you past the GF Wedding Chapel along the SSL.