I have similar experiences at times. Since I am almost blind, when I take off my glasses it is just a kaleidoscope of shapes and colors. People's faces just become abstract and I can peacefully zone out. Some people notice and some don't. It is kind of annoying when they notice or if they bring it up. It is weird but sometimes reality is too "sharp" and by taking off my glasses, everything gets kind of soft. I can also zone out for long periods when wearing my glasses. Sometimes the human body has survival methods of its own that it provides us. Wish I knew what else to say.
It is interesting how there is a cultural dimension to all this. Many things considered neurotic or defense mechanisms in my country are considered sane and normal in Japan for example.