The tough thing is when the loony tracks you down through a comment you post on a common friend's wall and pesters you to add him back as a friend. Then he will demand to know why you de-friended him.
I had to de-friend someone and they bothered me about it once they found out.