My husband is the same way, except that he's done some extra hurtful things. If I were rich, I'd divorce him

As things stand, our children are living a more stable life if we stay together for right now.
I don't know about your husband, but mine had a bipolar father, and Asperger's and ADHD run in his family. A heady combination, of which I knew nothing when I married him, of course. He himself has been diagnosed with ADHD, and refuses to take his prescribed medication, which doesn't help with his overall functioning and anger issues. But I can't help feeling there's more than that. He is incredibly lacking in self-awareness, and shows very little empathy, which might be symptoms of Asperger's, for which there is no treatment. The worst is this: he ALWAYS thinks everyone else is to blame, and not him. It makes fixing the problems impossible, since he doesn't even acknowledge them.
So for now I find fulfillment in my own family, my children, my friends and my dog and my work.