I'm sorry OP, but if this were me, I would be done with this person. Maybe not this instant, but as others have said, I'd start making plans to leave. It's not merely that he said this extremely hurtful thing, but that it appears to be true and he continues to believe it. I couldn't trust this person with my heart a moment longer.