honestly is the best policy ALWAYS!! if he is a true friend he will understand how you both feel and how he has made an unbearable situation, and he will respect your feelings..he he gets mad, well you have your answer..just my opinion, but you can still be friends and supportive of his wife and not have anything to do with him if he doesnt or wont understand your feelings..good luck