In sept you should be ok. I'm really hoping that it cools down some more. I took DS at 6 weeks (he was preemie too) and he did great!
For the baby: standard diaper bag things (wipes, diapers +2, Paci, toy, bottle, formula (if needed), rash cream, powder, extra clothes, sun hat, light blanket...