I used to refer to myself as crazy quite often as did a few others, it never bothered me in the least.

Things that bother me are phrases like "A few bricks short of a load." or "He's not playing with a full deck.", there many more like this too.