Fair enough, but then the asymmetry of the situation remains the main issue. If he was joking, he should not have gotten offended when you joked.