I understand what you mean, AppalachianAxis... I'm an asexual (the official definition being someone who doesn't experience sexual attraction, not someone with no desire for sex, asexuals can still be sexually active) but I do have a libido; I find it aggravating to have something yelling at me I've no actual need for. (To clarify my position here, in essence, it is like food (if we borrow the current comparisons at hand!) where libido is like being hungry, a general feeling that says "you need to eat", but sexual attraction is like craving a particular food, or seeing a slice of cake and wanting it.)

So although I'm not in the same position as you of denying certain acts, because I have no desire to go and have sex with somebody so on that part it takes no effort at all, I can associate somewhat with unwanted sexual urges and the way they have a tendency not to go away, when you'd rather do something else with your day, like go shopping, do chores, or watch paint dry.