Roughly the same as Walt Disney World... it's the least busy when school is in session. Avoid summer, avoid spring break, and avoid major holidays (including major Japanese holidays).
January, February, September, October, November, early December
Of those, September and October will be the warmest and driest. November and December are surf season. January and February are whale season.