Yeah, I feel you.
Sometimes I say a lot of crap that accidentally pushes people away. I don't ever intend to insult anyone or annoy anyone. I'm not the kind of person who wants to make people upset.
I don't really have any advice except... don't change who you are just to please people. Some people have low tolerances and there's literally nothing you can do about that. There are plenty of other people out there who will accept you for who you are.