OH yeah. For me, that person is my grandmother. She helped me take care of my oldest child during a rough period in my life, but now that I'm clean and got my act together she never stops throwing it in my face.
I don't know what mental illness she suffers from, but I know whenever she acts out other family members sweep it under the rug, but if I dare finally lose my **** after she's been verbally abusive for months, than I'm the bad guy. It's BS.
Hang in there.