Honestly, it sounds like you two had a lot in common.
Not all relationships and friendships start conventionally,
My relationship certainly had I seriously unconventional start.
Anyway-it sounds like you got more from this guy than you lost, shrug it off and move on.