You are not responsible for his feelings- he is. I think if he wants to move out let him- but not without parameters set up so there is an end in sight. He cant have an open ended timeline for living somewhere else. He cant expect to have sex with you or for you to do any of the things you do now. He wants to live on his own? Then he takes care of himself. He still needs to contribute to your expenses, after he is choosing this lifestyle.