It definitely happens to me too. I love hanging out with my friends, when I can, and just crash when they're gone. A lot of it is self-doubt, I think. I assume that they can't wait to leave or stop hanging out with me, and that's why they left. Even though it's usually because they're tired and want to go home.

So, no answers, but at least confirmation that it's not just you.