The hallmark of AvPD is wanting relationships but having such low self-esteem that you don't feel worthy of them. That's what differentiates it from other PD's, not just avoiding people.

I would encourage you to see a psychiatrist who specializes in personality disorders, because if you have an incorrect diagnosis then you will not receive the correct treatment. It's possible you could find a balance and you won't have to go through such an extreme period of isolation again in the future.