The terminology I usually use is, "I don't do touchy-feely." That, combined with a big step back when people try, has always gotten the point across to people.