Hi OP. I have been lurking on this thread for a couple of days and felt SO BAD for you last night. I wanted to share a story of something that happened to me that may offer a little perspective.
My brother works for a non-profit organization. They don't make a lot of $$ and finances at the organization are always an issue. He called me 2 weeks before I was going on vacation in 2012 and told me that he had offered my house to a guy he knew through work (same organization but works in another state) for him and his family to stay in while they were in town. He had never met this guy, only knew him through emails/conference calls. I guess the guy was planning to come to our city for a meeting, but was complaining about how expensive the hotels were. My brother thought offering them my house was the perfect solution.
I went absolutely ballistic on him. No way, no how, absolutely would not even consider it. My brother was just flabbergasted. He honestly had no idea I would react that way. I guess he rescinded the offer the next morning. We have talked about it since. To him, a house is just a building. He doesn't feel any emotional attachment to it. He is also very trusting. He can't imagine that anyone would take advantage of that situation and besides, if they broke something, he was sure they would pay to have it fixed. No big deal to him at all. I told him that I would feel personally violated and that I don't trust anyone to stay in my house, even family, if I'm not there. My brother always thinks the best of everyone, I tend to think the worst until proven otherwise.
Maybe your husband feels the same way about the house? That its just a building? I am sure to this day, my brother thinks I way over reacted and was "mean" not to let this nice family stay in my house since I wasn't using it. Your husbands lack of emotional attachment to your house, plus his feeling of responsibility for his brother might be causing him to respond this way.
In NO way do I think your husband is justified what he did, particularly with the name calling and making you the bad guy.