You're in a complex situation and it sounds very uncomfortable. Amy has some good ideas. Avoid him, don't return texts, remove as friend on facebook.

I understand that it's difficult to set limits without coming across as mean. But this is causing you a lot of stress and you will eventually have to deal with it. It's just my opinion but if you let him befriend you and hang with you, you'll eventually blow up and then he really will have his feelings hurt. It's like a time bomb waiting to go off.

In the end, it may be better to talk with him while you're in control of your emotions.

But, remember, this is just my thoughts and I don't know much about your situation so I may be off base. Anyway, good luck with this situation.