I think it's important to learn the root of the fear. I was always afraid of men! I've realized this, thru a lot of reading, introspection, that it comes from my upbringing, in which I was taught that men are evil and untrustworthy. I always, also, felt "unworthy" of the men to whom I was attracted. This led me into relationships that were full of suspicion, jealousy,and fear. Also into relationships that were destructive, and attractions to the wrong kind of people. This all stems from a severe lack of self-esteem.
Realizing your history can be very liberating. Also, working on your own self-esteem issues. I know there are even groups/classes which meet to practice meeting and greeting the opposite sex.
It is very important to understand your history, and your mindsets. In my case, a lot of reading and introspection. Nothing is set in stone. You can improve.
Patty