It sounds like you have discovered that he is boring and self-interested. I can imagine that your transference bubble has burst and that is not comfortable - especially without the chance to speak about that with him in a therapeutic space. Presumably he knows about your history and relational pattern with men - all the more reason he should have been careful and respectful with you by not entering into this limbo. And he is not the only therapist who won't be afraid of you, he is not unique.