Get out of this 'relationship'.
He is *not* being appropriate.
There is a difference in using transference/counter-transference without breaking ethical boundaries (as it ought to be). He is not doing that.
I am all for acknowledging clients' responsibility re what happens in therapy, however here it is on him. Yes, you asked questions but *he* ought to have upheld moral and ethical boundaries so as to make the therapeutic space 'safe'.
It is *not* safe and he is not safe.
PS: Your gut instincts are also giving you the same message (i.e. warning), please listen to your inner alarm bells.