SilverTrees thanks for the feedback! I do think a bit of it is from the mood and anxiety, although some of it seems to go beyond that. My anxiety can be bad, but sometimes even when it is not I have the issues and in addition to memory I generally will feel like I am having a hard time processing information, doing tasks, feeling almost confused. I went to a psychiatrist a few years ago for my memory/attention and tried adderall, they didn't say I had ADHD but said maybe I had some attention issues secondary to my history of Lyme disease. I stopped it at some point and realized I felt better without it--it made me too irritable although otherwise helped some. At the moment I just take NSAIDs so I don't think it is related to medication.
My therapist would not do the testing as she is not a psychologist, but was recommending I see a psychologist (and if not a neurologist) for it. I agree, a neuropsychologist sounds like a good idea for what I need. I don't really want to take a bunch of psychological tests if I really just want cognitive testing portion at the moment.