It could be an obsessive thought caused by anxiety. Unfortunately I don't know how to avoid obsessions; probably the best thing is to try not to be upset by it. Does it stress you to have this thought?