This is what it all comes down to. Who are these people so busy not having fun that they have all this time to judge folks? OP, do what works for you and your family.
I wouldn't worry about what any thinks.....do what is best for your family we are a family of 5- DD14, DD12, DD5 (turns 6 on December 19) I am considering renting one for him too...that way when his older sisters want to stay in the parks till closing, he can sleep in the stroller if needed! He hasn't been in one for a while....when I asked him if he wanted one so that he could rest when his legs were tired from walking all day....he said YES, PLEASE,