That's true, we all face temptation regardless of our beliefs. And I would hope that your T could recognize that just because others may not talk about their "sinful" desires or feelings, it doesn't mean they aren't experiencing them. It might just mean that others aren't as courageous as you are when it comes to facing those issues.
If you keep that in mind, it may help you believe that you are just as worthy as anyone else to be in a leadership position within your church. You are probably far less likely to act on those desires and feelings than many other people simply because you are willing to acknowledge and face them and work them through, whereas many other people would remain in denial and try to suppress those feelings. Those are the people who tend to get caught off guard by the power of "sinful" desires feelings and they are at higher risk of acting on them.