I agree that it sounds like he didn't want to use the same words with both of you. Especially since your anniversaries are so close to each other. My guess would be that he didn't mention it when he saw you in the morning because he was distracted by something, not that he didn't think your anniversary was important.