I think you sound like a very nice person. Really! You are insightful and intelligent.

I also think you may be projecting a lot of your fears onto people. This makes it very difficult to interpret interpersonal interactions.

Have you considered seeing a therapist? Therapy is a safe place to explore these feelings and can be very helpful in sorting these type of things out.