I do them a lot as well, but that's precisely why they annoy me

It doesn't bug me when other people do it, but when I'm talking and I keep doing it, even though I'm consciously trying not to do it, that gets really frustrating.