WL, Poly, and GF share a number of their bus routes. If the Downtown Disney route is one of them, the next stop after WL on the way to DD would be the Poly. (TTC isn't part of these routes in general, as I understand.)
To get back to WL, you could take Boone or Crockett from the TTC. (One of them will go straight to WL, the other will go all through FtW first, having just come from WL - I can never remember which is which.)
Similarly, either Boone or Crockett can get you from Hoop de Doo to WL. (Same caveat applies as to which it is!) Or - it's walkable, if you're up for it.
Maybe I'm an oddball, but I find WDW transportation a fascinating thing to learn about - not just to use!