You don't have to "just let go" of the abuse he puts you through.

Are you seeing a counsellor?