You should respect his opinion but ultimately do what you are most comfortable with. I know my T would refer you to somebody else if she had been your mom's T. It would be a conflict of interest for her.

My brother in law and his wife actually called T to set up an appointment. She asked me a few questions without telling me any names and know it was family so she referred them to somebody else.