You don't have to find a rational reason. He will get the message and move on. Even if you have a personal preference for ethnicity, this doesn't make you a racist.