If you are talking about the pool at the Beach Club Villas, you don't need a card to access it.
If you are talking about the main pool, Storm Along Bay, shared between YC, BC and BCV then yes, everybody has to have their ID on them. It's a long walk back to the villa with your disappointed child if you didn't bring your young child's card. I know this from experience.