Oh I feel for you and I feel your pain and sadness.
It's NOT fair OR right what your husband is making you endure. Can't you ask him to please leave out of respect for YOU? If he has any human decency to him, he WILL leave the home so he can pursue his extracurricular activities with other women outside of your home and NOT under your nose! It's appalling what he is putting you through. That's SO disrespectful! And why aren't you angry with him? I would be enraged. I am not blaming you, but supporting him while he is having affairs while still living with you undermines all your sense of self respect and human dignity. You are very kind hearted towards him, yet you are doing yourself a great disservice.
Ask him to leave - or tell him to leave. It's not OK. You should not be taking care of this person who is also hurting you.