I have been in your shoes only about a month ago, where I changed pdocs and worried about whether my concerns would be taken seriously and if I could trust her. I can also relate to my old pdoc not caring or even listening much to what I had to say. The only difference is that I was in a crisis situation.

It turned out everything went just fine and I'm so much happier with my new pdoc. I came prepared with notes for her, just in case I forget to tell her certain things. Sometimes getting a referral from someone you trust can
help. In my case, it was my therapist who gave me the referral. If you are able to choose between different pdocs, maybe look up reviews or their profile on Psychology Today, which tells you something about their style. It can help put you at ease.

Regardless, just know that it is completely normal to be anxious, and it sounds in your case it is definitely time to try someone new since you were not satisfied with your other pdoc. Sometimes change is the best thing that could happen. You may find that once you get the initial appointment over with, you'll feel so much better knowing the new doctor now has your history, so the hardest part is finally over. Of course, remember it's also natural to not immediately trust a new pdoc, but being open to what they have to offer is important. If after the first appointment you get a bad feeling and have reasons that they may not be trustworthy, you can always try someone else.