Best to cut ties with this person and not be in an abusive situation, which is what it was. Don't worry about hurting him... he was cruel and therefore, boundaries must be established. Now he can no longer hurt you.