There is a problem if you don't want your own daughter to come over because of your husband. So he can take care of himself but won't have sex with you, his wife? I agree with TheSadGirl.