I don't think it will ever "feel" right for you. But like the others said. if he cheated on his wife he would cheat on you and more than likely has someone else as well. best to get rid of him now before it is too late. Take care