I get bad with isolating sometimes. For me it's especially with longer lengths of time, like if I don't leave the house much or at all for a day or 2 or if I end up accidentally being unsocial for a few days, it's harder to be around people after and it's easier to let more time build up isolating.
And a lot of the time, if I get into the mindset of wanting to be alone and then suddenly have to be around people, I get that interrupted feeling too and feel annoyed. I'm not sure whether or not it's a bipolar thing, though, hmm.