As long as you don't act on it I don't see it as a problem, its making a move on him that would be out of order !
I would tell my hubby how I felt as I am extreamly open and possibly try to avoide being near him especialy on my own. I am not advising you to tell your hubby as only you can be the judge of how he would react. Some men/woman would be very upset and hurt by knowing while others like me would fine it 'amusing'.
Also there is a chance your hubby has realised somthing is not right if he is with you while you are with him, I know I would realise but then again I look for this sort of thing as I am nosy lmao.
Good luck hope things settle down for you.