I believe some people are just genuine good people and don't go around being prepared to deal with insults. You must expect the best out of others.

In order to have a quick reaction, that means you would have to constantly act like a boxer in a ring and always get ready to dodge your oponent's next punch. You are a good person, please don't change just so you can have a quick reaction.

Your neighbor has a sad soul, you can't change that, but you can be proud of who you are.