Actually, you just made me realize the situations that make me nervous! I hadn't figured it out until just now!

The few people that make me nervous enough to want to avoid looking at them in the eye are people who tend to STARE into your eyes. That can be a little nervewracking for some reason. Feels too personal, somehow.

So maybe (and I have never met you so I have no idea if this applies to you), if you notice other people looking away, maybe you are staring too intently at them. Maybe you could try my trick of looking at them between the eyes, rather than in their eyes. What do you think? Do you think it applies to you?