If you're hanging on because you think he will change, he won't, people don't change be cause you want them to, they may change if they want to.

You need to confront him about this, open your heart, talk it out and if it still doesn't change you may be happier without him.