It is definitely worth bringing up. If you don't feel comfortable with him anymore, or male therapists in general, you may even benefit from discussing this with a new therapist.

I understand your concerns. My first therapist as an adult tried hypnosis with me after a month or two of seeing him. He was very kind, gentle, soft spoken, warm, etc. etc.....I also knew he was married with two small children so all of the signs pointed in the direction that nothing bad would happen and that I could trust him. I wasn't able to fully go under but I think it has to do with feeling discomfort and vulnerable in that situation. I was warned by friends and family to not let it happen again unless I brought a third person to session with me and that is when those concerns popped in my head.