She evidently is not going to stop seeing the other guy. It seems then that your choices are:

1. Accept that, or

2. Leave her.

You don’t need to be apologetic or self-justifying about wanting to have an exclusive relationship with her.

You seem to think that she is not already having sex with him. How do you know this?