You get to say if he crossed the line. How would he act with the shoe on the other foot?
You need to talk this out between you. Work on that counselor again maybe.