It is totally a anxiety symptom. Happens to me all the time. Many times, I don't even notice it; someone will come up to me and tell me.

Bad thing is, there's nothing you can really do to make it stop except be less anxious. Most of the time with me...that ain't happening!