Short answer: if you don't have a good connection with your psychiatrist, then yes, it is extending your suffering. Even if you are dealing with mental and/or emotional health issues, you have a right to fair, ethical, and respectful treatment; everyone does. In fact, it's part of what a doctor swears when they become licensed. If you feel like your psychiatrist is violating this in any way, you have taken steps to amend it, and/or you no longer have the energy to deal with it, I say go elsewhere. I have been through enough therapists and counsellors (mostly good, but short term due to the circumstances of the therapy) to know that it's just not worth sticking around in a situation that doesn't feel good when I already don't feel good most of the time anyway.
Nothing to be embarrassed about.
Hope this helps.