Attraction? sure. That is completely normal but when you describe what you think of the woman from work I do not see mere attraction. The fantasizing and wondering what it would be like to be holding her hand etc, I do not think is normal. Does it happen? sure but nevertheless it's a sign that something is not entirely satisfactory in your current relationship. A good relationship would give someone enough contentment and satisfaction that these fantasies would not be happening.