It sounds like you are in a relationship with someone who doesn't respect "your" boundaries.

He should "not" have visited you during that convention either, that was for "you" and he had no right to insert himself into that convention that was meant for "your" benefit.

If you have PTSD you have grown a lot more "sensitive" to your need for boundaries and if your husband compromises that and then consistently "denies" that he has, even by acting "dumb", it's no wonder you have gotten to a point where you simply don't want to be around him anymore.

The fact that even when you get "angry" your husband decides to get even more agressive at invading your boundaries, means he really doesn't respect "your" boundaries "at all". It's no wonder you don't want to be around him.