Hey, geisha75. The move sounds like a good idea in many ways. Maybe you can share your fears with your nurse practitioner to see what she thinks. Perhaps she could go to bat for you with a new doc, but I'm not sure how that works.
As you say, though, you might find a doc who is willing to allow you to stay on what is working and not insist on any changes.
Best wishes!