I had the same problems with groups I joined. People seemed nice but I just didn't feel comfortable. I think some of it could be anxiety related but for me some of it is related to the fact I try to mind read and usually find I think the other people see me negatively, which I think stems from my self-esteem.