Sorry its so long, but it's not all that boring

, please read and give me your views. THANKS!
So, as some of you know, I'm already dealing with the childhood sexual abuse thing but for a while, there is this thing that's been bothering me.
I suck at setting boundries with outsiders, at home I'm an "okay" assertive person.
So, I have/had this married guy friend, I'm in my late 20s, he's in his late 30s and has kids and is happily married. The way I first met him:
Last year, I met a guy at a conference who forwarded me to this guy and I was looking for a job after graduation. At that time, I kept it very professional. He'd send me friendly emails (nothing sexual or bad), normal friendly, which I didn't expect because I was treating it strictly professional. Then he said I didn't have to be that professional, so i loosened up a little and I THOUGHT we were developing a friendship UNTIL!:
He ended an email of his with "with love, kisses, and hugs". Made me really uncomfortable but I ignored it. He also mentioned something like "somethings happened to you in the past so you dont open up easily". But the thing is he would never open up either... After this incident, I thought he was trying to get into my pants and avoided him until I somehow changed my mind and decided to give it a chance, since i'm bad at building friendships and i thought maybe i should try and give it another chance, maybe this could turn out to be a nice friendship, ignoring my intuition. oh and he always addresses my name with "sexy" which i dont always like but have never said anything, feel i might be rude?
This time, he invited me to lunch and his family happened to be there, i met his wife and kids, I WAS SO RELIEVED!
But then! I met him again for dinner a while back when he was visiting my town, and he said he was trying to figure me out, as in.. I'm in my late twenties but I'm not married, I don't have a bf, I don't have a career (although I'm trying to work towards one right now and he knows this!).. so then what about needs. And i'm like what needs?
Basically he was asking me if and/or why I did/didn't have casual sex. Or how i satisfied the need to be held in guys' arms. I told him even though I felt very uncomfortable. But after that I felt sort of violated (i know maybe its my bad boundry setting skills because he caught me off guard). I felt violated because I told him something that was about my personal life without realizing it was personal, until an aquaintaince told me later when I discussed it with the aquantiance, that the married guy was being rude.
At the same time, I felt VERY CHEAP and shameful! The whole situation made me feel cheap. Like a cheap, trampy woman. Wasn't he trying to judge me? AND HOW DARE HE!
He's pretty helpful in putting me in touch with people in the industry, etc.
Was he trying to get into my pants???