Wow, you have got yourself in quite a muddle huh! I'd say it's better to be safe than sorry and just tell him he's not your only sexual partner and that you just are being sensible about it. Seems the best way. All sounds highly confusing with his wife - are they going to divorce or something? Hugs, M.