I have never found it to make any difference in my enjoyment of the cruise on which side of the ship I was on at any port. If you are not facing the port then you are facing the beautiful water. In key west the sunset would be on the port side of the ship.
MJ