It is fine. Try and stay in buildings 23-25. First bus stop in, easy walk to last bus stop out (HH). we find the biggest problem with the buses is waiting for them in the parks, watching other buses come and go. But, you would also have spent that time getting to your car, or waiting for a monarail or boat, or sometimes walking to your resort.
Unfortunately, Disney has not yet come up with enough pixies dust to magially transport us to and from without any time passing!