If you stir in the oil it won't be too hard. It's not like that's added oil, that's the natural fat from the peanuts. Which is monounsaturated ("good" fat) and is necessary. Of course it has a lot of calories, so only in moderation.
And, I always refrigreate the natural peanutbutter.
And, I always refrigreate the natural peanutbutter.