I've always worn my prescription glasses on all the rides, coasters included, and have never lost them. Do your husband's and son's glasses fit pretty tightly? I think unless they're very loose fitting, they should be fine to wear them on the rides.
-Melissa