Do you think that the fact that he is a man is what is triggering?

Or is it some mannerism or something he is doing? I personally don't do well with long silences.