Are you planning on taking Disney transportation or driving?
If you are going when the parks are open, I would do the following: Take the bus to MK and then take the resort launch from MK to Fort Wilderness. it is then just a short stroll from the dock to the restaurant.
We also got there one time by taking the bus, but it was confusing--I think we took a bus to Fort Wilderness, then took the internal bus to area near trails end.