Two related things kind of jump out at me from the long reply -- you had an "awesome birth experience" and you want to change your career to become a midwife?
Are you really sure that it is children that you want, or pregnancies? There is an odd mental phenomenon out there that is akin to an addiction to pregnancy and all of the special attention that surrounds it. It sounds from your reply like you might be hovering perilously close to that, especially since you say that you have given up on the idea of more than 5 children, but now want a career change that will put you in the company of pregnant women every day, and let you re-experience childbirth (in a way) on a regular basis.
Here's the thing: you are not going to get rich being a midwife, and if you become one your time is largely no longer going to be your own. If you get called out on a birth at midnight and the mother is in labor for 18 hours, then your DH is going to be dealing with the children on his own while you are attending that birth. It's one thing to be an OB/GYN with the kind of income that comes with that, because physicians usually make enough to afford household help, but if you can't, then you are unilaterally deciding to put your husband in a position where he may be flying solo with the kids for a few days each month on an unpredictable basis. (My own OB is a mom, and when her children were young they had a live-in nanny for just this reason; her husband is an attorney and could not easily rearrange his schedule if she had to do a delivery when the children needed to be taken care of.)
If you currently have the kind of job that lets you arrange your hours easily to manage the children's needs, he may well be thinking along the lines of: "OK, now she wants to switch to a job with really unpredictable hours, which will make me the primary caregiver, and if that's what she wants, then I think I should get to decide how many kids I'm taking care of."