Thanks, everybody.

I discussed this with my mother who also spends some time in the office and she thinks I am imagining things. It doesn't bother anybody else.
Even if I'm being silly, I think I need to find a way to explain this problem to my secretary without offending her. It's hard for me to be friendly to her lately, because her perfume bothers me so much. I can't credibly blame it on customer complaints unfortunately.

I've just got to admit that it bothers me even if I'm the only one it bothers.