When I first met my current boyfriend, who I truly feel is my soulmate, I was in similar circumstances. Not only am I Bipolar, but I have ASPD, which makes it very hard for me to deal with interpersonal relationships.
I met him & went totally head over heels in 60 seconds flat. I just HAD to know him & every little detail about him. I was confident that I was going to land this one. A few weeks later, I start becoming reclusive & stopped talking to everyone online, including him. I was like, "I really don't need anyone, especially a relationship. That's just way too much trouble & I am just going to get ****ed over". Fastforward again to a week after that... I start sleeping with one of my exes & get into a relationship with him, meanwhile I am having episodes while on the phone with my current & unveiling truths about myself that I've never felt comfortable confiding in anyone else with. Next week, I break up with my ex, & my boyfriend makes the move on me. Now we're living together.
Sometimes, you just have to go for it & take the chance if there is the possibility you want to have a relationship with him. What's the worst that is going to happen? You're going to find out you guys weren't made for eachother? It's all about a learning experience & about living your life, versus standing on the sidelines wishing you had done things differently. Unless he's a genuinely bad person & there are strong legitimate reasons not to go after him, there's no reason not to try. Do what makes you happy &, if you wind up unhappy, start over & try again.