Someone will always have a problem with something someone is doing, so why bother asking others opinions and just do what you feel comfortable doing. I would prefer my daughters go into the ladies room.
If I had a son, and was bringing him into the ladies room, I would do so, unti lI felt he was capable of handling things on his own and wouldnt hesitate walking into the mens room if i felt there was something wrong or if he was taking too long, etc. I also would not say a word to a man who came into a ladies room looking for his daughter.
Kids first
Other folks opinions second.