Hello, netsavy. You can't work? Any job at all, for any number of hours per week? Really?
I don't mean to be insensitive, and I don't know you, but I think that you're strong enough. Work can be very stressful, especially for those of us dealing with mental health problems, and for most people it isn't fun. But, it's necessary to work so that you can pay your rent, buy your food, meds, etc.
It probably isn't a good idea to work as much as you have been, for your current job. Your panic attacks are a sign. Our knee-jerk reaction to anxiety, however, is avoidance. This is exactly what you plan to do. You will never learn that you are safe, and hence have no need to be anxious, at work if you do not go to work. There are forms of therapy for anxiety that expose people to what frightens them, so you can think of your job as therapy.
Like I mentioned, you don't have to work as much as you have been. I think that your therapist is wise to suggest that you work less, and focus on your treatment more. Perhaps you can start looking for a lower-stress job while you taper down your hours at your current place of employment.
I hope that you continue working somehow, though. You deserve to feel capable and independent.