Many men are afraid of the rejection. They will not take a chance for fear of ruining their self-esteem. Also, it depends if there is a pre-existing relationship with the girl. Because once you ask her out and get rejected, the relationship becomes arkward after that.
If it's a total stranger, men feel much more comfortable taking the risk.