If you're not comfortable removing the aerator, for whatever reason, consider getting a Brita pitcher (or similar). Easy enough to use, although you would have to refill it, etc. We plan to bring one down for next year (our first trip home!) and possibly leave it there. Perfect for refillable water bottles, the coffee maker, making lemonade to keep in the fridge...
We used to have one, but don't need it at home. I'm hoping I can find it before our trip, if not, I'll buy a new one. They're not too expensive, and we take our water very seriously in this house.