I believe, without actually checking the Lynx website, that the 300 series buses are the commuter buses which operate only in the early morning and late afternoon - mainly for people to get to/from work.
Number 50, from the Transportation & Ticket Center, is the bus you want. Take a Disney bus from POR to the MK and then ferryboat or monorail to the TTC.