I agree with what others have written here. I think given what you've described your feelings are totally understandable and normal. And almost inevitable, in fact.

The thing would be to work with your therapist to figure out how you can get the support and caring you need outside of therapy without feeling like you have to put up with things that compromise yourself.

Your feelings towards your therapist are pointing you to what you need. Not what you need from your therapist, but what you need from life. You might be able to get it from the people in your life by standing up for yourself and making new demands on them that they meet your needs. Or, if they are unwilling or unable to do so, maybe there needs to be new people.

I don't think your therapist's response to your disclosure that you felt love towards him ("you don't even know me") was super helpful. The truth is that many therapists are freaked out by expressions of romantic or sexual feelings and don't handle them very well. It might have been better if he'd said something like, "Thank you. Why do you think you feel this towards me now? What allows you to feel this way?"

You can always bring up the topic in therapy again. Just say, "Hey, I know this makes you super uncomfortable, but I am having these feelings and want to talk to you about what they mean." Otherwise, if you can't talk about this in therapy, your therapist becomes one more guy with whom you feel you have to stifle your true self in order to get caring. You can even tell him, if you feel this way, that he handled your disclosure of transference badly. Being honest like this is excruciating but maybe it would be good practice for being honest in other relationships as well.