Hi tallguynolove,
Not feeling any love towards others or yourself makes sense to me, given your past.
Why should you love your parents or brother? Have they shown you love? NO.
Why should you love yourself? Because if you were worthy of self-love, you would have already been shown love by family members.
Forgive me if my assumptions of your thought pattern is incorrect...you can post, "Wrong!" and we'll go from there.
Sexual intimacy, and your lack of emotional bond to others, goes along with your lack of self love. In case you haven't heard it already, they say, "You can't love anyone else if you don't love yourself."
That concept has been very difficult for me to accept for many years ~ believe me! I still struggle with the concept. But I can see how this applies to your lack of interest of developing any relationships. You aren't willing to put your emotions in any relationships. I hope that I don't sound as though I'm yelling at you ~ I'm just saying it like I see.
I would recommend working towards accepting your childhood. With a professional, who can validate your emotions and guide you through discovering who you are. It can take a while ~ I've had to do the same thing myself ~ but self-discovery can be pretty cool. It's fun to discover that I do have real interests, and accept that I also have compulsions. I've yet to develop self-love. I hold tightly against that idea. But I will admit that I'm not real evil or "deserving of misery". THAT'S a big step for me!
Hope that this makes sense to you. Best wishes!