I went in May carrying a number of pins and my lanyard in my camera bag. I unzipped the bag so they could search it and put it through x-ray. No problems in Chicago or Orlando.
If you are wearing the hat, I'd suggest taking it off and putting it on the x-ray conveyor. Most detectors now are set to be very sensitive -- my credit cards in my wallet will set them off!. This way you can avoid possibly being searched.