not a problem - when asked when you first check in - just say you are interested and also when they call (and if they call) just say the same thing.
I almost quiet answering the phone - but that is a bad idea - sometimes the activities change or the pool is closed (you know babies in the adult pool.....) and that is how you are told.
OL is a big, big place - you would be disappointed to leave your room to go swim only to arrive and find the pool closed.