IMO I think your story about the other guy kInda hurt him. I can see myself telling the same kind of story, I sort of have, to my T. Men get jealous. They don't want to hear about other guys finding you attractive. Maybe his wife was unfaithful and so this is a very sensitive issue for him. Talking about this with my T has shown me how not to build myself up at the other person's expense - which is maybe what you were doing? "Look, this other guy found me attractive." Your neighbor already found you attractive or else he wouldn't have asked you out. I don't know if this is fixable, it's up to him?