Do you feel rejected? I think I would if it were happening to me.
Maybe that's the problem, the feeling of rejection.