first, let's remember that everyone forgets things. even my friend with the "perfect memory" occasionally misplaces one. expecting perfection is something that people who are terrified of spontaneity do (the boss).
there are several things that affect memory, starting with genetics, add stress or head injuries,,, so many things affect us. what i have learned is that there are two things we can definitely do to improve recall and performance by improving focus and memory.
one is to realize that "multi-tasking" exhausts the brain and makes things worse. focus on doing only one thing at a time, and don't think about what is waiting for you. as suggested, i have been advised to keep lists, "to-do" lists, etc. they can be helpful, esp. at work. think of it as a 'flash drive'

.
the other thing that can improve memory is meditation. if you have any interest in this there are several places in the PC Forums to read about it. Mindfulness Meditation, discussions of Buddhism, DBT, all have discussions about meditation.
i hope you find a way to overcome the boss's irritation about this very human experience. best wishes~
Gus