Yes, of course, if you needed to call it's more than ok!!
Is the specialist he referred you to a female?
I have had two therapists in my life. One, a woman, I worked with for 3 1/2 years or so. I had a great deal of respect for her and she was very supportive. Now, I am with a male therapist and it has been an intense relationship. I think this time around I am getting much more out of my therapy than I did with the female, but I'm not sure if I just wasn't ready at that time or if it was a gender issue.
In any case, maybe he can help you in some way, if not to see you, then at least to find a therapist you are comfortable with.
Take care.