if you actually did a swab test on common surfaces you would be totally grossed out about what would grow and the probably origins.
But guess what!
You are exposed to them everyday, the majority are not pathogens, and for most people the normal flora of your body will out compete what you come in contact with. If that doesn't work then the bodies immune system takes over, and if that doesn't work fast enough or well enough then you may be getting sick. And this is everyday people, the atm machine, the keyboards, the door knobs, the fast food counters, the handrails, the bus seat, the desks in classrooms, all over the whole entire world are germs and skin flakes and hair and what have you from other people.
Then antimicrobial movement is actully a problem because when you use antimicrobial products all the time 2 things happen, you wipe out all the good normal bacteria you have and are used to, allowing an opportunity for opportunistic infections, and the continual exposure to antimicrobial products increases the chances of resistance developing.
Your risk is much higher of contracting a food borne illness, but that is another topic