That is a very great question!
I will take a stab at that. In my opinion there is a danger as well in the areas that you have mentioned. I just believe that draw of attraction to the opposite sex is stronger and not only that, God has given us that attraction purposely. That being said our sexual drive is a God given attribute that was and is acceptable by God ( Done in His standards, whole nother topic) . Now the other things you mentioned to safeguard against are not God given but the sinful heart of man.
Do I have a desire for women YES I do, God made me that way. Do I have a desire to steal WELL NO but put in the right situation I may be tempted to do so.
Eve in the garden was giving the desire for adam her husband( God given)but she was told to stay away from the fruit but she be began to rationalize eating it ( satan)( well its good to eat , I want to feed my husband and it will make me wise, I would like more wisdom as the women of the home ..... rationalized her way right into it ( unnatural unlike sexual attraction)
We are drawn to sex a beautiful gift (GOD HAS GIVEN) to a man and women
We are drawn to Sin opposition to what (GOD HAS GIVEN) but in our natural sinful state as humans.
Finalizing I would say this ...Sexual attraction this God given Attribute coupled with our Lustful sinful nature makes it a stronger and more dangerous of all temptations!
hope it helps . Just my take on it