I'm not sure if he crossed any lines or was inappropriate. I AM sure that he made you very uncomfortable and it gave you a lot of anxiety. I am a believer in listening to your "gut" You already know what your gut feelings were. That's all that really matters. Move on. See the new therapist. Put it behind you.
tulips