There is a lot of overlap between AVPD and Schizoid PD. I would say that your low self esteem and preoccupation with other people's opinions of you is more indicative of AVPD.

PDs are difficult to diagnose. I was not diagnosed with AVPD until I had been seeing my T weekly for over six months. Your Pdoc may not yet know you well enough to be able to tease out a PD diagnosis from similar or comorbid disorders. You could ask him or her to administer psychological testing if you want a definitive answer.