I took the Disney bus from the Swan to the port. I could've taken it back too but we stayed one night in Cocoa beach and took a shuttle straight to the airport. It picked us up at the Swan then went to the Dolphin then the beach club then Yacht club then the port. Coming back it will likely drop off in the same way but reverse.