I have been denied to refill my water bottle at places with the fountain drink machine. They instead give me a cup of ice water. I have no issues at places that have the tap thing (like the stand outside of Cafe La Bamba) though.
I think the water tastes fine but I'm used to the Florida water.