Most dysfunctional families have a scape goat..and it looks like you're the one... that you are advocating for yourself of course shines the light upon their ways and makes them feel worse (though they don't know the real reason??)
Do what you need to do to heal from this family's traditions.