Whoa!!! Not okay. You have your reasons for not returning to him, and he needs to respect that. It sounds like he hasn't changed a bit, if he has only nasty things to say. Good for you for staying true to yourself and doing what's right for you. Don't let his words hurt you or bring you down. You will find someone beautiful you loves you for you and only treats you with kindness.
__________________
Never forget how loved and beautiful you are!!!