This coworker of yours isn't the manager so as far as I'm concerned, her opinion doesn't mean jack.

So what if you're quiet? It's not like you're working in customer service.

Personally when I'm doing a job I want people to leave me the hell alone and let me focus unless what they have to say is directly related to the job.