I have the same kind of anxiety as well. My therapist always says to stay with the anxiety/keep doing what you're doing unless it becomes entirely overwhelming. Sometimes it's hard for me to judge what "entirely overwhelming" means since my anxiety can get so bad, though. Have made progress, though, so it's doable!
Side note: I do take an antihistamine prescribed for anxiety when it gets too bad and starts interfering with my ability to work/function.