Hmmmm.......I smell a conspiracy!
Just kidding, you have every right not to let them scan if you don't want them to. Same as I have the right to prefer that they do scan.

You did say that you don't focus on it while you are in the parks, it's just a preference as you are walking through the gates, like my preference to not carry a bag or anything that needs to be searched, so I don't have to stand in a security line.
Now, remember everyone...I warned that there would be jokes...
Now, I would think it odd if you were wearing camo with palm fronds on them the whole time and trying to blend in with the foliage so that you could fly under the radar (so to speak) and not be coerced into having pics taken on Main Street by those highly-questionable photo pass people (who knows what they use "those" photos for!) Or, if you were concerned that using the fast pass system would compromise your standing as a "good" private citizen (you do know that when you utilize a fast pass machine and enter your park ticket, it's scanning for finger prints, right)! But, not wanting a finger scan to be made that enables the park to keep someone from using a stolen ticket is completely cool with me.
Jokes over - continue reading
Seriously, all in good fun.

You're not obsessing, it's just a preference that you hadn't seen noted before. Where would Disney World be today if not for someone being an individual many years ago. It's not something I ever thought about before, so it has created thought & discussion. Cool!
Hmmm.... it's getting late here and I'm feeling silly, can you tell????