"You should have said no more forcefully."

He said he had been trying to get me to have more of a sense of agency.

He also said he would never know what it was like to be a woman being raped but that most women wouldn't either.

If you see him again, take his statements to show him that the issue is about his beliefs, not about the good work you are doing. From my perspective, your work is not about voicing anger over his so-called misstatements (he meant the things he said and continues to support them), you are angry about being invalidated. That's not therapy. That's revictimization.

He needs to see that he was wrong, apologize as many times as it takes, and get some training about SA.