Hey Blue!
I can relate somewhat. People often comment that I don't talk enough.
Like you, I talk when I have something to say. Sometimes, I have little to say.
I am on Abilify which has added some rather flat affect and/or some delayed response in facial expressions, as well.
I have been getting a complex about this, as there are frequent remarks about my lack of "talking." Sometimes, I do not find the talk around me very interesting, which only adds to the mix.
I have wondered how some people might respond if I tell them I feel they talk too much?
Sorry you seem to be getting similar feedback.

WC