Are you safe? You said your husband is physically abusive.

Is he abusive to you or children too? Could you get law enforcement involved? I think having an affair might be even more dangerous under these circumstances as he might become violent over this affair and possibly violent towards your affair partner too.

Is there any way you can take children and leave? Go stay with some family? You might be in danger