I've seen videos of plenty of lovely small weddings at SBP - sometimes with just the couple and their officiant. I don't think your party will feel overwhelmed by the place, and if it's the spot you really want, stick with it!
As for me, I really love Sunrise Terrace at Wilderness Lodge, so that would get my vote if you really want to switch!