I find this super frustrating.

it is worse when said person adds something along the lines of, " and, don't talk to me like that."
and then you're thinking why ever not?. you just spoke to me like that yourself