in my opinion your relationship with your family is the greatest importance, find out fully what is causing your stress and fears and confront your family with this, ask them to help you cope, if you'd had done this before the party your family would have recognized what attending the party meant to you and hopefully would have supported you in this.

co-workers come and go, family stay forever in your life, they are the ones to depend on and help you through your bad times.