The outburst to me, is a very Positive Sign that you are now aware of your Anger towards him and maybe some other family members. Awareness is the 1st step towards working through angery feelings. Maybe he was the easiest family member to be agery with and the safest one. No, you are not "Crazy".