I don't know of any 100% organic grocery store. Whole Foods is not, Sprouts is not, Trader Joe's is not, Fresh Market is not, and they never have been.
I shop at Whole Foods all the time - it's only 5 minutes away, and get a mix of organic and conventional items. Their produce is usually better quality compared to other stores in my area.
And, the idea they're more expensive ... that isn't the case at all in my area. I get 8oz noosa yogurt from whole foods ... $2.69. Other stores in my area have it at $2.99. The deli ham I get at whole foods ... $11.99/lb, at the alternate store, it's $14.99/lb. Plus the 2 that eat it say they much prefer the whole foods ham. Annie's mac & cheese that my kids eat ... cheaper at whole foods. Lots and lots of stuff like that. Cheaper eggs, cheaper hummus. They usually have good sales on things too.