I usually only make eye contact if I am angry with the woman or at the end. Usually I look at the wall just past her head.
She has never mentioned it. Maybe she has never noticed. Once I was looking out the window over her head and that disturbed her - she kept turning around to look out and finally asked what was out there.