Mostly people who ask this a lot are insecure.
I would ask them- why do you think so?
If there were a reason for me to be angry I would answer to this question yes or no.