First off... Never blame yourself for something a trauma had left behind on you. Acknowledging this thought pattern is a great first step to recovery. If you do not already, I would look into an affordable therapist that specializes in these types of situations.

People are people regardless of gender; some tend to treat other awful because they have past baggage too and since your trauma happens to be hyper sensitive towards men, it might be worth linking up with a women's support group then eventually joining a mixed gender group after working on this struggle with a professional. Good Luck to you~