Most people mistake agoraphobia for being a fear of people when it really means a fear of being in an undesirable situation without a means to escape; agoraphobia doesn't always directly pertain to people.

With that being said, I fit the bill for having agoraphobia much more than social anxiety because I can usually function just fine in social settings as long as I either have control of the conversation or I have a means of escape if I begin to feel trapped.