I have a family of 5 and my 4 year old can't ride a lot of rides. If we use rider swap does everyone still need a fastpass or can my husband and oldest daughter get one and I get a rider swap pass so that I can ride with my other daughter when they get off? TIA