Aw, it's a shame, but I think teen boys have it rough sometimes. I think that some people, like this guy, are just watching you and waiting for you to make trouble. I can guarantee you that a bunch of little 10 year old girls would be no issue for this guy.
You know when you're doing something wrong and when you're not, so stand your ground. You sound like a fine young man.