The only way to make sure you are "safe" is to continue no contact, and block him if necessary on all social platforms, your phone and email. If he threatens your safety in ANY way, you can call the police.

And yes, I would say that he was being abusive. He used classic abuse tactics on you to make it seem like YOUR problem and like YOU'RE the crazy one with issues. He took zero responsibility for his actions, which is also a classic abuse tactic.

Good riddance to him.