You are right they do sail to Caen although it is not exactly Caen where you arrive.
I have done this sailing and all the others that Woodview mentioned several times.
Its impossible to say how rough it will be as it depends on the weather. I have done some journeys where it was extremely rough...