You could try to talk about an accommodation with your employer's HR or employee assistance people if the company has either. A toxic work environment is not good for your anxiety.

I hope you find a way to make work better for you.