
Your boundaries should have been respected. He disrespected you, and then tried to push his way on you - because he wanted the old you and wanted you to conform to his liking of you, not seeing you as a person deserving respect, but rather a woman-object that is supposed to cater to the man's needs. This kind of man-dominating behavior needs to stop.
His attacking you verbally was gaslighting. Instead of apologizing to you, he accused you of being too harsh or whatever. That's like saying that women can't scream or raise their voices or change their names or have their own thoughts, goals, envisions, etc. You, like any other man, have a right to raise your voice and ask for your needs. But you weren't even raising your voice. Instead, you were stating a boundary and telling him that he was violating your boundaries and requests. Would he do that with his man-buddies? Who knows. But the way he treated you was really sexist and spoke to his needs of who you were to him years ago - as a sex object to him - which he tried to preserve for his own screwed up pleasure in thinking about you that way - or whatever he does when thinking about you. It's sickening! It's gross! It's objectifying women!
I'm glad you finally spoke out!