I don't think it's wrong to be annoyed with someone's personality - some people just don't click. In most situations people who don't click just don't hang out, and that's fine. Unfortunately you're in a unique situation where you have to hang out with people you don't care for. I suggest getting a job when you feel able to and saving up your money to move out, so that you will be able to choose the people you spend time with. Until then, it sounds like you're doing a good job at handling things. (Except for the sl*t comment, but we all make mistakes). Don't be hard on yourself, feeling annoyed is a common human emotion.