Hello, daman25, and welcome to Psych Central! You do sound like you have a level head. I agree that hanging around with certain people can bring us down. But, as you suggest, you are comfortable with them and having some trouble reaching out to new people.
I suggest you post about this issue in the Relationships and Communication forum and look at the Work and Careers forum to see if you would like to post there.
I think you will get some good advice from folks in those places.
I hope you can regain control over your life soon.