For me too. Everyone seems to not know how to do anything I routinely do while I am away. A pile starts as soon as I leave the office and just grows. And grows. And GROWS.
I don't think about it until I come back to work. I'm a little miffed for the first few minutes of the first day back, thinking: "Why couldn't they have done this...all they had to do was...they left this? OMG! I'm gonna strangle someone...they can't be that incompetent."
Then it passes.
I forge through it. And remember that the pile of work that I come back to is job security. Whether it is because they are unable or unwilling to do it, I don't care. It means that I am a little more secure in my employment.