Wait my dear. Your first job in life is to take care of yourself. And bringing an end to this relationship is self-preserving your mental health. It was the absolute right thing to do.

Please try to think of this not in terms of guilt because his feelings are hurt. You did not hurt his feelings. You took an action to preserve your own mental health and sanity. Think of it as acting in your own best interest. That's what you did. Congratulations for taking action to protect yourself. I know it hurts, but try not to ruminate about it. Take steps to move forward and focus on the positives in your life. I know, so much easier said than done. And resist his attempts to reach out for you. That is frankly selfish on his part...is does him good, but only hurts you. That's not a friend.