Its always best to do the safari early in the day. The animals are naturally more active during the morning hours. That said, however, I've done the safari at various times of day and always get a good show. If you go on a chilly day, though, be sure to have a little sweater or windbreaker as the trucks go pretty quick and it can get breezy.
Steve