Here is what I would tell myself if I were in your shoes:

Geez, Onward, get over yourself. Of all of the millions of men out there, these are NOT the ones to focus on."

I mean, I would literally say that to myself because that is just how I personally think - not that I think you need to get over yourself.

Do you think your feelings of desire toward male authority figures stem from your relationship (or non-relationship) with your father? I don't presume that that is the case, and I don't need you to respond - just a rhetorical question that may help you come up with the "why." Knowing the why can put the whole thing in perspective and not have it be an issue. Life is hard enough without inviting difficulties into the workplace by allowing inappropriate relations. Be kind to yourself and just don't go there.

BTW, it is totally normal to feel attraction to others we work with/for. We are human, after all. The key is to be able to not let it interfere with work.