I've told this story before, but it is worth repeating here. I have never, ever concerned myself beyond a minor comment to whomever I was standing with, when someone excused themselves forward in the line. I might have mentioned it but I never really cared.
The only exception to that happened at Soarin'. As you know that is a painfully long wait anyway. I love the front row, but have never said anything or made any special requests to get in it. Luck of the draw was my rule of thumb. Anyway, after waiting half my lifetime in the Q, we were finally up toward the front. There were about 4 people in front of us, so we were going to be in the front row. I was truly excited because a number of my group had never been on Soarin before and, as I said, I feel that the first row is the best experience.
Just before we were going to be put in the final Q, the group in front of us told the CM that some of their friends were further back in the line and they wanted to ride together. To my shock the CM said, "no problem, we'll just have them come down here and join you. She then proceeded to wave them down...they were about 50 feet back...and put them with the others. This meant that we were just bumped from the front row. I couldn't believe that this had just happened. An official Disney sanctioned line jump. For the first time ever I was angry. As we went down to the load area I found the next CM and told her what had happened and said that I really wanted the front row and I felt that I had just been "screwed" out of it.
She did put us in the next loading Q for the front row. Yes, I know it ended OK, but I felt guilty about raising a fuss about it. As I said, something I had never done before in all my years of going to WDW.
I have since calmed down to a low roar but it really just reinforced my mental concept that it didn't matter and the stress I felt that day was not worth the front row. Now I never notice who is where or why they are there or how long they have been there. It just isn't worth it.