I don't think you're a pervert, but I would agree that your behavior isn't...in good taste, so to speak. But I think you're making good steps by understanding that this isn't okay, and I think the fact it does make you feel bad is a good thing.

Once you start rationalizing this as acceptable is when the true problem starts.