It feels wrong because you're a good person and you want everyone to be happy.
Life unfortunately does't work that way, some of the hardest decisions I have had to make were the best ones.
You just have to stick it out and keep your eye on your goal, whatever he chooses to do to himself is his own fault, not yours. He's a grownass man.
Don't let your guilt trick you into believing you are in the wrong