My husband rode ToT, SM2 and Rock'n Roller Coaster many times and he never had any problems with his glasses.
But if you feel saver, maybe you should buy one of those bands, you can fasten your glasses with and hang around you neck. You know the one with the small rubber loops at eachend. I don't know if these bands are still sold in shops, but they've been very popular a few years ago.