If your husband would agree to "couples" therapy, that is best.
If not, get into therapy by yourself, for yourself.

His boys are old enough to deal with this.
If your husband gives in to them, he isn't the man you thought he was.
A decision does NOT need to linger here.
You have your kids to consider as well.

Wishing you the best.