It seems to me that your ex-husband was being unacceptably disrespectful and unkind and taking advantage of your insecurities. That is on him, not you, I think.