I prefer lens cleaning fluid and lens tissue. In the field this is not convenient so I use a microfiber cloth or a t-shirt (usually microfiber anyway).
As long as there is no grit on the lens a t-shirt is not likely to cause any harm, even my oldest, most used lenses don't appear to have any scratches on them.