I wonder if it would be better to change the question that you are asking yourself? Maybe you should ask why it matters if people are mad versus whether they are mad at you? I say this because it causes so much stress and anxiety to worry if other people are mad or upset about something. I tend to do the same thing and I know how hard it is to change the habit.