"My therapist tells me that he needs to take reponsibility for what he did. That there were many options he could have excercised besides having an affair..."

Yes there were...here we are now...I'm so so sorry...

As you try to redifine yourself - you might want to look at two words "doormat" (generally passive) and "assertiveness"...