Your not able to go come and go as your wish? He’s miserable and it sounds like you are also.
I hope you find a way to help decide how you want you and your children’s life to be. He doesn’t have to like you seeing a Therapist or clergy or whomever to talk to.. but it sounds like you really need to start making plans.
Stay safe