You're making sense. I have had a thing with patterns before, too. In my experience, breaking pattern won't cause any bad to happen.

When I was younger, my toys that were red and blue had to go in that pattern. Red, blue, red, blue. All other colors were fine but those. One day, my older sister was sick of me arranging the toys as such and broke the pattern. At the time, I thought for sure my mom would die. She didn't. My mom's still alive and kicking.

I have to remind myself of that whenever I get the "pattern issue".