Yes, you can do fast pass and baby swap. We always do. I think they let you keep the original FP too, so if you are traveling with a big group someone will be able to use the FP and the person with the Baby swap pass gets to bring two people with them.