No building is really far from anything at POFQ. We stayed in Building 1 which is known as being a little further and it was still not even a 3 minute walk to get to the main building or bus stop. My guess would be Buildings 3 or 4 since they are closest to that area.
I have stayed at bldg #5 and twice at bldg #3. I like #3 because it seems quieter, slightly away from the pool, but close to the food court and the bus stop. I would request #3 again. I love POFQ!!
We had 3 our last trip and it is really quiet. It wasnt far at all to the bus stop. Before this, we had 7 and again its not really far from anything. You sort of find your own "best" route out depending on if you are on the front or the back IYKWIM
Just got back (had a great stay), #4 is definitely the closest to the bus stop. We had a river view room in building 7. It was probably the furthest room from everything, but as others have pointed out, the resort is so compact, it wasn't more than a few minutes walk.