It is a "good" sign that he's putting his fists through doors/walls instead of on you but I agree it's a bit too much to take. He has to learn self-control and it doesn't sound like he'll do it with you there if he thinks you are pushing his buttons. Make sure you see a lawyer so you move out/kick him out "correctly" so there won't be problems later.

Did you all ever try joint/marriage counselling?