How are you with eye contact?

As for me, I don't mind looking at someone's eyes, but it scares me when they look back. For some reason I feel embarassed when people see me looking at their eyes. Also I feel more comfortable talking with my eyes downcast instead of ahead or up (which is necessary for eye contact). Lately I've been trying to look at people's eyes from over my glasses instead of through, so everything including them is fuzzy, that's less scary for me.