That, dearie, would be nigh impossible to say with so little information. There are more subtle behaviours which may indicate future violence. If you can recognise these, you may be able to make a more informed decision.

I'd say **** him all you like. If he assaults you or does something which makes you feel like you may be in danger (isolates you from friends and family, constantly pushes boundaries, makes threats, etcetera), then just leave. But my therapist tells me you poor normal folk can't simply disappear yourselves from a relationship, even if said relationship doesn't yield personal gain, because you have these bizarre things called "attachments"... Must be such a burden...