Maybe you aren't choosing the right people? For me, coming from a dysfunctional family, I found it more comfortable to be around dysfunctional people, but they can give you trouble. You see, healthy people really look at you and see you and if you have low self worth this feels awful! So a person can avoid healthy people for this reason. I found healthy people and then worked through my discomfort about it.