Yes, you can walk to TTC from Polynesian.
You can also walk from Grand Floridian to TTC - you need to walk past Polynesian to get there, so it’s not a short walk.
The usual boats from Grand Floridian and Polynesian to MK are small and not accessible.
Fort Wilderness and Wilderness Lodge have both small and large boats (alternating at times).