I don't usually look into a person's eyes, though I can with people who are very familiar. Well, unless of course they are rather close-physically, I mean.
Really, I've but two options:
I either avoid a person's face altogether or stare at whatever feature I find the most distracting. Whatever the case, I'm deemed rude.