Eh, I personally would just ghost him after you meet your new pdoc. He didn't take your concerns into consideration so I wouldn't worry too much about hurting his feelings. People switch doctors all the time.