Why would you even want to stay with her?
She clearly does not respect the sanctity of marriage (as she's been his mistress before), so what chance is there of her remaining faithful to you?

I'd cut my losses and run, find a girl with integrity, who is loyal and trustworthy.