No, trust me, the Ritz, the Four Seasons, and all else, WANT you to take them. Google it.
Problem is, they want to cut costs. I get it. I also bring my own WEN style cleansing conditioner, my own soap (I use a combination of Dial and Dove, so bring both, a couple bars of each, and throw them out when I leave).
I wouldn't use a dispenser on the wall, my own choice. Others may do as they wish! I'm sure they're fine.