If you care about their friendship and their feelings then I'd suck it up and host them eventually. It's what you do for people you care about. It's called hospitality. That said, I think it's perfectly fine and smart to have boundaries - like timing that also works for you and time to plan accordingly for groceries etc.
I am a little jaded - It makes me sad how uncommon it seems to be getting for people to host other people in their homes anymore. In any capacity: coffee, dinner, kids' birthday parties, occasional houseguests, etc.