Uh yeah, the CL CMs totally get to know you after, like, one visit to the lounge. So I don't really think trying to fly under the radar would work too well.
Not to mention, how are they planning on getting in there? Every single CL we've stayed in, you've had to have your band (well, it was just the room key when we were there) for access. I guess you could sneak up in the elevator with people going to CL, like at WL or AKL, but what are you going to do, just hang out on the floor with the CL rooms until someone gets in the elevator, and then hope they're going up to the lounge? That's stupid.
At the boardwalk you had to walk past the CM sitting at a desk and then swipe your key if the door was closed. So, not sure how you'd get around that one. Plus, again, they know who is staying CL.
And at places like the Poly and GF--how exactly do people think they'd reliably get into the building without a key? Again, just hang out at the door until someone came by? In the Hawaii building, there are at least two CMs right there in the check in area that I think would notice if people were just chilling outside the doors until someone with a band came by.

That's a little on the Captain Obvious side.
Even if they could get in, it's totally stealing to use the lounge and eat the food if you haven't booked that room category. Good lord. Talk about entitlement!