people who are not safe to me...Eventually there is just no contact.
I'm the same way. I'm afraid of the rage inside that comes out when I'm threatened...not of the person or situation. I don't allow the rage to manifest outwardly, and it works against my health.
I've come to a point in my life where it's best just to walk away from those people.