What you do to your ingrowns is sort of similar to what I do to my hair - I originally started pulling it because I noticed all these thick, frizzy hairs on my head that I wanted to get rid of, so I pulled them out. Maybe you notice your ingrowns because they're different? If that's the case, maybe covering them up would help, so you can't see them.
Good luck, anyway - hope you manage to stop!