Cold turkey. Stop all contact with him and those connected to him. You deserve better than second place. If you are single and available find someone who is also single and available. You would not like it if you were on the receiving end of an adultery so don't do it to someone else.