It’s not easy to leave at all! I don’t know who are those others for him it’s easy. I don’t know if you need to leave but I do know you can’t fix him. Good for you to have hobbies, work, pursue interests and focus on stuff you can control. It’s a healthy way to live.