Would you say that maybe your comment to the first guy may have been a sort of trigger for him, and he responded by saying that to you? I think sometimes even though we may have good intention it's difficult for the other person to get that immediately and will respond in a completely different manner than expected.

Alsoi ts kind of difficult to base others perception of you on a comment like that. I don't think he was being wholly objective. You said that he has some issues w social anxiety so he may not have wanted to respond in such an abrupt manner. It may just be difficult for him to interact in a more positive manner