It isn't rare I express an opinion but it is rare that I assert that my opinion is truth. I'm gonna do something I rarely do and say that someone that does the things you have described is an abuser and it not only will not get better it will get worse.
I also suggest that you tell anyone you trust that is near you about his behavior and get the support of others to remove yourself from the situation.

Waiting for this guy to do something 'really bad' is like saying you'll leave once he grows horns, a tail, turns red and starts carrying a pitchfork!!!