Make a choice. Stay in the marriage, for whatever reason, but stop the cheating, or end the marriage and start the new relationship. Be faithful to whomever you choose but just choose one.