Even the great Thich Nhat Hanh has said his mind wanders sometimes when he meditates. So, no more self-judging. It's not a competition. Just acknowledge the thought and bring yourself back. After you do this for awhile, you will actually get better at it. It will become a skill.