You did the right thing, telling him to leave. He needs to take responsibility for himself. He treated you badly all those years ago, and expects you to take care of him in return? It sounds to me like he's just found another way to try to control you and take your energy. Good for you, standing up for yourself!