If you are happy alone you can try to minimize the contact with people. Being irritated it is normal as you seem to have no interest in socializing. It takes courage and a lot of patience to do so, since you have to be a good listener.

Personally, I find social situations irritating when I do not feel ok with myself, as discussions with people seem bring up issues that stress me out. But otherwise I think socializing gives you perspective in your life. We tend to be so self-referential sometimes that it can get repetitive and very static. I would recommend to take baby steps in trying to socialize, first with people you tend to tolerate and trust more and maybe discuss those issues with them.