It's very likely that subconsciously, you are picking up on their lack of confidence, that you are identifying with it. and are somehow attracted to these types yourself, on an unconscious level.

Let me ask you this: do you love yourself? Do you feel confident about who you are? Do you feel like you are broken yourself?

If you don't love yourself, feel confident, or if you think you're a broken person too, these are the same types of men you will energetically attract. The way to stop that pattern is to work on loving yourself first, increasing your self confidence, and changing your viewpoint on your history and story.