Yeah I also have this problem. Smells/sights are what trigger my memory. Sometimes I remember really random things because I'll see or smell something that I associate that thing with.

Anyway, I think you should try for a job. It's possible to have anxiety and work even with a shoddy memory.

https://actuallyadhd.tumblr.com/

^ This tumblr page has a lot of ways to help you get organized and stuff to succeed. Hope this helps.