That fence is closed now due to CarsLand. You'll have to walk all the way up Harbor to the main entrance. It used to be that you could cut thru the Katella fence and catch the tram to the entrance. No more.
I agree, the walk is more like 15-20 minutes to get to the main entrance.
Jolly Roger gets pretty mixed reviews -- see tripadvisor.com
BW Stovall's is a good choice if you want to stay on Katella and the walk is no problem if you cut thru the Grand Californian.