Do you have a therapist? It seems like something you could easily discuss. Perhaps work on your self-esteem or your social skills? I believe there are several books on the subject.

Have you ever been rejected by someone in the past?