OP....I have always tested high in reading and comprehension skills (my spelling has always, without fail, sucked). I picked up reading immediately in kindergarden, and took off. Never looked back. I had free range of the books in my library. Frankly, some of them had content that I was in no way prepared for. I read Little Women in the 5th grade easily. I liked it, but I didn't get it until I read it again later.
I went to a private Catholic Elementary school for the first part of my education, and it was pretty pathetic. My second grade teacher had no problems letting us know that she thought children were vile little creatures. I was having trouble understanding math, so she terrorized me to the point that I not only peed my pants in her class, but I also have since had trouble understanding math. I was put into a FANTASTIC public Elementary school after that, and it was incredible. Great teachers, great staff, great environmnet. Middle school? Back to suck-land.
We moved before my freshman hear of High School. The new public school that I had access to was a pretty rough school, and my mother had no desire to put me in for the few months that I would be there before we moved to a new state. I homeschooled that year. She pretty much just tossed the books and the teacher's guides my direction, and I tought myself. I needed a little help in math (who says teachers can't make a difference) so I spent extra time on it until I understood the material. That was my decision though, as I knew I would be entering school again the next year, and wanted to advance. I learned a lot that year, because I chose to. By the by, that is not a scenario that I in any way recommend, but in my particular case, it worked out okay.
I went back into public school in a new state the next year. It was a wonderful school with incredible teachers. My socialization flourished. My abilities to socialize were stunted a bit, not from homeschooling, but because of the backstabbing, dog eat dog, downright dangerous environment that I'd been in during middle school. The new school was an entirely different environment. Laid back, supportive, safe. Very intelligent teachers, lots of personal help. I still needed help in math. We had a brilliant math teacher. My DH (well, now) wound up being my tutor in trig because I had no clue what was going on in there (it's worth noting that I made it to the trig class though). That had nothing to do with my homeschooling, and everything to do with the fact that I look at a blackboard covered with numbers and promptly break out into cold sweats. I actually had a teacher in college that broke through that and tought me some cool stuff, but I digress.
I still graduated 6th in my high school class and majored in English with emphasis in creative writing in college. I didn't graduate because I couldn't afford to finish. DH was our school valedictorian, and went to college on a full ride scholarship. He majored in Computer Engineering.
I said all of that to say....I've had a look at several sides of the argument here. Knowing all of that, I think that schooling in an environment where the children spend time with their peers is important. Lots of people pull children from that environment for lots of reasons, some better than others. Lots of parents don't handle their children's subsequent educations as well as they should, but lots of parents do.
If I were in your situation, I'd start off by getting a public library card. If you can, be a room mother so that you can get more of an inside look at what's going on here. If after that, you still felt your children were getting a sub-par education, then pull them. But I'd be on the lookout for a better public schooling environment. There is a lot to be gained from a good school environment. Access to art, theater, band, choir, foreign language, plus things like Beta club, dances, sports, etc. You could spend a long time going through it. Some of it you can recreate in a homeschool environment, but I'd imagine not without some expense and a great deal of work.
Personally? I wouldn't hesitate to take my DD out of school for a year or two. DH and I are perfectly capable of handling a few years of elementary or middle school education. Ideally, we'd use the time to travel, and teach her the things that she can't learn in school, while giving her a little break from public education. After that, back to the grind. But, that's me. That's my opinion, and I get one.
I hope that I've helped in some way, and not just taken up a ton of space here.