If you took a vow then it doesn't sound like you are asexual. I don't think someone who truly has no interest in sex would need to take a vow.
Some people are just very touchy about sexual and gender labels. It might be best to just drop the labels thing and avoid the grief.