I don't feel that you are wrong in trying to find out the truth. It is your right to know if someone is being true to you or not. I'm in a similar situation but I'm not married to my significant other. I don't understand why you can't tell him you know about all this stuff.