You can start checking in at 10:30 or so. We always get there at the opening of the terminal. I would rather spend as much time on the ship as possible!! We do not mind waiting in the boarding line. Time goes by very quickly.
The ride from WDW to the port is about an hour so you can judge what time you want to leave there.
MJ