We have a 1 and 3 year old and stayed in building 4. The parking is close, including the garage. There is a pool there, but you will probably want to go to the main building for that pool, river, and kids splash area. It is a short 3 minute walk, just remember the decking used along the pathway as you approach the pool is blistering hot. The cobblestone is hot, but once you hit the decking watch out. (Or enter the pool area by going up a series of short stairs and back down)
You are also about 5 minutes from the pirate pool. The other slide pool, park, and mini golf are on the other side of the lake so not a quick walk.
Lots of people have used vacationupgrades including myself with no issues.