Try not to be too hard on yourself. I'm sure you can get over your fear. It will just take time. If you can get practice on some easy routes at quiet times (something regular would be good) and then build up from there, that could help. If your fears get in the way too much, you may also need some therapy to help with strategies for dealing with that.