I experience the same thing. My appointments are always in the evening after work. I see my doctor twice a week, so it can cut into other activities, but my doc is really patient and doesn't mind me texting or sending an email if I am really overwhelmed after a session. Usually, if I can come home and chill out, it isn't as bad.
I hope this helps. You are definitely not alone.