When I had issues with my pituitary gland, I saw an endocrinologist. I had a MRI quickly, and continued blood work for quite a while. Luckily it was a flook in my case and I have been fine ever since.

Go back to your primary and enlist their help, ask for referral to an endocrinologist, and do not give up self-advocating.