you say you're not a feminist but if you read your paragraph.....you basically defined yourself as one. and feminism isn't just about power to women, it's equality to ALL. that includes men, transgendered people etc...

a good way to look at it is think about how him acting like that defines his character. although you might have lust for him, you don't have love for him. because any man that treats a school aged girl as a sex object is, for lack of a better phrase, f-ed up. so, instead of focusing on the physical attraction or your attraction to the IDEA of him, think about what him acting like that means. I think if you think about it that way you'll have another realization. And this one will be "how could I be attracted to such a pig?"