I've had this same problem and my doctor said its an irritated sweat gland and a few times I had a swollen lymph node. As long as it comes and goes, you don't need to worry.