People like that want me to not ask them about their day, lol.

I'm sorry he was so insensitive. This happens to me at times. Often I'm apt to give a smartalec reply such as after you tell me ## times, then question why I might still be asking, lol, but I have found that trying to discuss it more sensitively and adding that I know it must be frustrating on their end, etc, often brings out their compassion. And if it doesn't, it says more about them than me and I just carry on with my day.

It's not your fault that you didn't remember. At least parts and you care enough to ask and he'd do well to remember that probably.