One person who knows animals wrote that a cat will go to a person who is not looking at the cat, because stares are not good in the animal world, and if you look at a cat it may think you are staring at (challenging) it. So, she says, people who do not like cats do not look at them, thus attracting the cat!