I don't mean to chirp in late but going to third the you're-not-alone and man-this-sucks. If I were to label myself correctly, I'd say I'm a homoromantic asexual, which let me tell ya, made it all the more confusing growing up just waiting to 'get it' - that crazed feeling everyone around me suddenly had.

I too, have a few instances of SA in my past which may or may not have contributed to it.

Have you tried looking around online asexual spaces for men with your interests? At the very least, it may bring ya a few new friends to feel less strange in your ways?

Best of luck to ya!