I think you made the right decision by not going to the Birthday.

It may be time to hang out with your other friends, since you want people who genuinely want to spend time with you, rather than do so out of guilt or obligation.