I can understand that but you are underestimating your abilities to build a better life with better friendships and more rewarding relationships.

The other way of looking at this is that time spent with this forbidden person robs you of opportunities to meet other people who are not forbidden.

I would definitely advise you to stop the sex right now, sex can be addictive because we release a whiole lot of feel good hormones including ones which make us feel bonded to a person. You will need to be very strong to stop this but you must if you are going to have a chance.

Glad you are realising the impact on his wife, chances are you aren't the first and may not be the last but you can stop being the one he is cheating on her with right now.