It is not physical versus mental, it is violent versus not at the expense of someone else. Mental aggression could still be manipulative and harmful. Consider this line at the end of my recent letter to a doctor:
"...it would be inexcusable to ever again attempt to justify such a refusal while relying upon a lack of knowledge and/or consideration of certain challenges faced by autistic or mental-health patients such as myself."

I was aggressively advocating for some accommodation and never once did I criticize or demand -- ex: I did *not* say what had happened to me had been inexcusable -- and then yesterday the doc's office called me and offered the desired accommodation. I suppose we could call my actions passive-aggressive, but the point is that my words were aggressive without ever being violent.