Absolutely; it's a great way to go tour another resort and get an idea for whether you'd like to stay there some time in the future.
The only limitations you have is that your refillable mug can only be used at the resort you are currently staying at, and you can only use the pool(s) of the resort you are currently staying at.