Sounds a lot like myself as well. I find i have to practice what i'm going to say to people on the phone, or else I get too anxious when i'm talking and I stumble on my words. I hate calling people. I hate when people call me too. As soon as i see who it is, and its a person who i can just text, I'll pretend I missed their call, then text them to see what they wanted.
I also do the EXACT same thing when it comes to eye contact and long stories. When i don't know the person very well and they're talking to me sometimes i pretend that the things happening around us are distracting me so i have an excuse to look somewhere else. As far as the stories go, I have trouble paying attention, and i find myself auto answering, without even realizing it! My sister called the other day, and i didnt want to talk so bad that I didn't realize till after I hung up that i had no idea what she said!!
It makes me feel really crappy, but I don't really know what to do about it either