I wouldn't like to hear this either, but I think he just chose an awkward wording. Like if he had said, "sometimes I feel triggered by your stuff too", it wouldn't have sounded so bad. Maybe you can bring this comment up at your next session and he can have a chance to explain further. He might choose words that aren't quite so awkward or just the discussion itself might allay some of your reaction.