The right answer is obvious and you state as much. I just kind of wonder if your husband knows about your activity. If you have an open marriage and it's okay for the two of you to seek other lovers then what I am about to say means nothing.

But... If it's a monogamous relationship then your activity is doubly dangerous since you could potentially ruin what you have. Now, maybe you are not in a good marriage and that doesn't matter to you (ruining it), I am just kind of throwing out a consequence besides the guilt you will feel, the potential of meeting a dangerous man with whom to hook up, etc. If you are doing this outside of a monogamous relationship behind your husband's back, you are not only going to have your own personal guilt to deal with, but you'll have ruined your husbands life as well. Just something to think of and again, I am saying this assuming you are happily married and monogamous.

You also can't use the "If he was an *** I could do this and feel fine" excuse. That would get you to do what you clearly want to do, but it wouldn't remove the guilt you might feel later. On top of that, if he is an *** and you want to remain married and work on him not being an ***, work with him if you love him. Don't use sex as a weapon to go against him because of an action he may have taken. If that's your attitude, that you will go hook up when things aren't how you want, you'll never have a healthy relationship.

And this coming from someone who has no ability to have a relationship but sometimes I am better at giving advice than taking it.