I wouldn't tell you what to do, especially from only one post of info. Only you know in your heart. If you don't have kids, the leaving is easier. It's definitely time to sit him down and tell him how fed up you are, changes must be made.