I often get hallucinations and paranoid delusions both during and outside episodes, although I'm fine now.

As long as I'm not a danger to myself and as long as my voices aren't commanding, my therapist helps me work through these things by teaching me coping mechanisms and giving me ideas on how to distract myself from them.

I'm not saying it's not a big deal, but psychiatrists and therapists are mostly concerned about self danger and danger to others. That's probably why he said there isn't anything to be worried about. HOWEVER, if you are legitimately concerned and you feel that you are at risk for hurting yourself or others, definitely tell your psychiatrist and therapist (if you have one). That's something your psychiatrist and therapist need to know.