It would be my guess that the majority of people have, no matter which party is married or not.

But we are adults and we need to have some self-control, either because it would interfere with our work environment, or it would be morally wrong.

Personally, I think you are inviting trouble by wanting her in your life. I also think you are trying to convince yourself that it can remain a friendship.....