sounds like you both have done a good job avoiding temptation so far, but for how long? it is unlikely you will let his text go by unanswered as it sounds like the two of you are already having an emotional affair. if you are planning on leaving your husband already, can you leave him sooner rather than later so he does not get caught up in the middle of this and suffer extra hurt?
if you can though, follow through with the request for no contact and don't text him back, or simply say yes, you are serious about no contact, although I know that will be hard for you. he is the one opening the door that he shut here, very unfair for you if he is expecting you to be the one to follow thru and make sure nothing happens. good luck