Sometimes people will do that to me too. They'll look away when I know they are looking at me and I look back. Sometimes I feel angry when they do that because it makes me feel like they think I'm weird or something. Just hold your head up and keep confident. Don't let it make you feel self conscious.