Universal Truth, I have been waiting for your update since back then. I think that your husband is really mean in how he suggests that the counselor has feelings for you. I think he is trying to say that just as the little one has feelings for him and just as the little one thinks that you are a bad wife (from which it follows that she might encourage him to divorce YOU), so does the counselor have feelings for you and is encouraging you to divorce HIM. I think this is the schema he is trying to outline, because it makes the situation symmetrical (just as I listen to the little one so do you listen to the counselor) and gets him off the hook (in his mind).

Do you think that might be happening?

You can (in the counseling session perhaps?) state that the little one formed her opinion of you (that you are an abusive wife) as a result of his efforts at persuasion. right? Since she did not live in your household, how else could she have come to believe that you are an abusive spouse? So it was his doing. If he wants to save the marriage, he needs to undo what he did, and no, stopping to talk with the little one would not undo what he did. He needs to talk with the little one and explain to her what is going on in reality, and explain enough for her to come forward with an offer of friendship with you. And if he is not willing or able to that, then, tough luck and you won't have to hear about fishing trips from him anymore.