Fantasy is entertainment for your mind, just realize even if you indulged with this person down the road you would probably be in same place you are now or worse, Plan some fun time for you and your husband!
Just think it through to the end it is not worth risking your marriage if you love your husband! good luck!!