Your behaviour does not sound passive aggressive. People who are pa do not express their feelings openly. They either don’t express them in a straight manner or they do so aggressively.

Could it be possible that you changed in counselling but your husband didn’t?

His feelings are not your responsibility, only how you react to them. Have you considered a strategy to follow if he does not change?