Oh course I can update
So the town came and shut him down. I was told that the only way he is allowed back onto his property is if he's there to fix his violations and make it right. He hasn't fixed our property, but the town told us that he will soon, and I know he has to fix ours before he's allowed to start working on his house again. I'm fine with that for now because we have the town on our side.
However, we did get a notice before summons in the mail a couple of days ago that told us we were in violation with our shed being too close to the property line. It has to be 3 feet from the property line and ours is 2 1/2 feet. I called the town law department, told them I had the land survey with the shed on it, and faxed it over. I figured I could just shave off 6 inches from my shed and fix whatever violation we were in. The town called me back, thanked me for the documentation and told me that he wasn't about to split hairs over 6 inches. He didn't realize the builder was reporting me for something so petty. I guess he was trying to get back at us for reporting him? The town told me not to worry about it and we are no longer in violation.
Other than that, I still have to see him when I go outside, but I'm lucky he hasn't tried to say or do anything to me!