I think it is too bad that you have left your old life behind. If i were you, I would try to build a relationship with new people or some of your old friends. If you are just dating this guy, I don't see any big problem, but if you eventually want to marry someone, I don't think he's a good bet. I have been married 28 years and my husband does not see any of his ex girlfriends and never has. That would make me feel odd. My husband did have some friends that didn't like me (I think two) and they drifted off. My husband and I now both have many individual friends and couple friends. My own friends like my husband, if they didn't i probably would stop spending time with them.
Bottom line, I would not want to be in a relationship where i felt like people didn't like me.