I think it's important to consider the circumstances, and from what you have described you weren't doing anything to even provoke him, which means that you will probably always feel afraid of an imminent beating as there doesn't seem to be a precursor to it.

I'm sorry you are afraid of him, and that your relationship is over.