I'm with all of you, this annoys me. Way more than it should. But even if I decide it's not worth my time and effort and decide to toss the container unemptied, then I face recycling/trash guilt.... containers have to be clean before they go in recycling, and putting plastic into the trash can is a big no-no.
And to introduce another pet peeve: CLAMSHELL PACKAGING! Risking life and limb, not to get the last little bit of product, but to get the first little bit!