Your feelings are valid. Don't worry you're not alone in your feelings. I don't like talking on the phone either when I don't want to. I just went through something with a friend who probably hates my guts now and gave up on me because I ignored her phone calls.
When you don't want to, you don't want to.
Its just the way it is. Hope you feel better soon