Thanks for the replies so far! It sounds like the memory loss may be a lot more extensive than I thought. I thought it would mostly be short-term memory loss.
I'll bring it up with my psychiatrist, but judging from this it sounds like keeping it as a last resort is probably right.