I always go with the earlier dinner time. Just in case there is a long wait, plus 4:40 is kind of an "off" dinner time and it may be less crowded. Also, the 4:40 ressie will have you eating dinner at dinner time anyway by the time you are served....
Go with the earlier--just to avoid the stress!