I recommend personal, private counseling FOR YOU, not him. This is about YOU. You need to make sure you are not doing this out of fear, weakness, or something else, like the fear of moving forward or as you call it "settling". I don't view settling as a negative, but preparation for the future.
I sense great fear in your posts. (to quote Yoda...

)
This is why...
You married under pressure. You "gave in".
You are in turmoil and not working it out with your spouse.
You wanted to live together but didn't because of "disowning".
Now things are driving you crazy and you want to run away and not face them.
You are second guessing yourself as a way to cloud your mind, they call it "distraction". You focus on the past, mistakes, "feelings", etc... instead of moving forward with this person (being honest and working on it).
How many things does your dh do to bother you and instead of compromising you "give in"? Make a list.
Now I am not saying you need to stay marriage. That is for you to decide.
The old saying is...."No matter where you go, you take yourself with you." This is a true statement, believe it.
"Feelings" come from "caring". Caring is an action verb. What are you doing actively to create a positive marriage? What is he doing?
Does your spouse actively do things (not say), do things to boost your marriage?
I like to do this analogy to help people understand that. For example...You see a small child crying in the store. You feel bad that he is sad. However..."feeling bad" for him does NOT help the child.
Only walking over and helping him to safety will. That is what caring is.
Stuff to think about...