That's anxiety AND fear.
This is an experience much like mine. I have the extreme fear of losing touch with reality or going "even crazier!" when I am anxious and especially when I am panicking. If I hear a sound I cannot identify, I am afraid that I imagined it, that my mind is playing tricks, and that one day I may never be able to tell what's a real sound or what my brain is producing.
There IS a lot of mental illness going on in my family, but no schizophrenia that I know of. However, you HAVE to remind yourself that this is the anxiety disorder talking to you, and it is never sensible or realistic. It is exaggerating the minimal risk. Remind yourself that the problem is anxiety and don't let it tell you that you have more issues than you really have. I believe if you let yourself dwell in these thoughts that it is possible to begin producing the symptoms you fear, or over analyze very small moments of hallucinations or uncertainty about what you saw. (ie, I will startle if I believe I just saw a figure in my peripheral vision. EVERYONE experiences this, you are NOT hallucinating.)
I always feel so bad when I am talking about this fear of mine on these forums. I don't mean to ostracize people with schizophrenia even more by acting like they're beyond crazy! I love you guys and I know that you are good people.