Water. Obviously you can see more when you're coming into port, but you're pretty far away from the coast while sailing.
ETA - coming and going out of NY, you're bordering Long Island which has no colors, at best you can see the beach (and it'll probably dark sailing back into the city). And what I remember of the Canadian ports, they were kind of in industrial areas so more gray than pretty fall colors.