Avoidant personality disorder is more of a wide range of avoidance behaviors, not just avoiding going out in public... Agoraphobia is a phobia, it is specific and NOT wide ranging like a personality disorder which would encompass every aspect of their life.
I have mild agoraphobia and I've had the exact same panic and fears from having to go out. AvPD has never come up in therapy for me and I doubt it ever will.

Also you don't always need medication to help with panic disorders, sometimes you just need a lot of therapy. I really suggest you talk to a therapist at least. What helped me most was just having someone to talk to that knows what's going on. Medication just made everything worse for me.

Also welcome to pc )