Keep talking to him, tell him how his reply made you feel, and put aside the thoughts of retaliation. Give him a chance to expand on what he said, and to defend himself