Hello Wallflower,
I have this same problem. It use to be worse when I was younger but it gets better. What I try my hardest to do when I have a one on one conversation with someone is to look them in the eye as much as I can tolerate and try to stay completely focused on what their saying. If I allow myself to get distracted while I person is talking I finded it harder to keep that eye contact. Although this is hard trust me I know when you talk with someone in a one on one situation try to absorb yourself totally on what they are saying make sure to look at them and just stay focused on what they are saying don't allow yourself to get distracted by brain saying look away just keep focused on the topic of conversation. It takes practice but I find that when I am completely absorbed in what someone says I tend not to think to much about the eye contact going on between us. Hope this advice helps you a bit. Take care and good luck!
Jenn

Jennifer