I just want to add something on behalf of your daughter. I had a friend that married a man like this. Their son is very insecure because his father periodically takes off with another man and he is afraid each time his father is never coming back. Also I would be afraid of passing HIV to the infant. If he is having unprotected sex with you maybe also with the men?