I can relate to what you are saying. When someone is in need and hurting, I get hooked into their issues and try to be present. When coming to your home, you can change your mind. Tell him you aren't up for company right now, leave it at that.
If he continues to call you can answer or not.

Being kind for yourself and to your friend is golden.
good luck
Jade