I'm sorry work is being so crappy.

How would divorcing help your family or stress? As for your husband taking care of baby. Do you feel your husband would physically hurt your child either out of frustration or otherwise? Would he neglect the baby's needs for hours? If you do baby needs a sitter when you're not around. If not, dad has his own style. Your correcting him is probably more harmful for Daddy/baby relationship. Is he getting help for his issues? Have you thought of getting marriage therapy?

Have you found out why he masturbates instead of being with you?