As an accessory? Not normally, but I do have two. One I bought for a specific reason, the other was a gift. Every now and then I'll add them to an outfit.
As for real scarves, I do use them. The warmer, and fuzzier, the better. I hate the winter and they keep me warm!