That happens to me, too. There are multiple reasons. Some people are just born Highly Sensitive (see the book by Dr. Elaine Aron). For others it may come from trauma, anxiety, autistic spectrum or physical reasons.