Just keep working on it. You are able to get to his office, so working on going just across the street was a good next step. Try not to be afraid of being afraid. Just take each step one at a time.