To add. Sometimes coming back to the person directly can help "Did you mean.. . " whatever it was they seemed to say.

It depends very much on the person and how much they mean to you/wider picture.

Sometimes I think people use passive aggression because they never learned to communicate directly.