Anxiety is very difficult to deal with, and very hard for people who don't experience it to understand. It sounds like even if you didn't struggle with anxiety, your family members would be hard to get along with. Have you thought about distancing yourself from them, or even cutting off contact completely? You have to take care of yourself first.