Bamboo I sound extremely like you. I haven't been diagnosed as avoidant, but reading about it here:
http://psychcentral.com/disorders/sx8.htm makes me certain I have it. It sounds like me 100 percent in that description. Im an introvert too and have low self esteem. Have never felt like Ive fit in with people all my life too and and ive had very few friends throughout my life. Pretty much have none right now other then online ones. I just avoid most social situations because I feel pretty clueless in them and dont want to deal with the possible rejection if I stay in them I guess. My life pretty involves me hiding away from people as much as I possibly can. I feel like so much stress when I am around people that I never feel 100 percent relaxed when any people are around.
Ive started going to therapy myself recently and have been going to a social anxiety group too. It sounds like avoidant personality disorder is like an extreme version of social anxiety. I think next time I see my therapist I will mention avoidant personality disorder and that I think it sounds exactly like me. Am curious if he will have heard of it or if it will really matter since it just sounds like a degree of social anxiety. Sounds like the treatments for both are similar.