Sorry for what you had to endure.

You aren’t married. You have zero reason to ever see or talk to this man. Well you’d have zero reason even if you were married unless maybe for the kids. The one and only way for your situation to improve is to not have this man in your life.

If he is harrasing you, get police involved. Otherwise be done with him please