It's one of the hardest things, and I think most of the time it resumes to just plain and old "Fear".
It happens to me too, and I'm trying really hard.
Take small steps. Sometimes things we think we are never get over, are not so hard after all, but do baby steps, just to find your confort zone and then move one from there.
I hope it works our for the best!