Yes.
You will need a notarized letter signed by him in addition to all the proper passports and documentation. Generally they require the specific dates that the child will be out of the country with you as well. The only time that this is not required is when both parents of the child are traveling with the child.
Good luck. . and have fun!