I know where you're coming from. For a while in the past year, I found myself doing the same thing. I would tell my wife I didn't feel well so I didn't have to leave the house to go shopping. I would tell her that I felt really bad in the mornings so I wouldn't have to take my daughter to school. You're not a lone, but I found that doing this was not helping my marriage in any way, shape or form.

Do I still get nervous going out, sometimes...yeah. I have to tell myself 1. No matter where you go, your symptoms go with you. Eg., I have had panic attacks at home, my "safe" place, major ones, just as I have had them at church, or in a supermarket.
2. The fears are irrational. For the most part most fears are irrational. My fears of bridges, elevators, tunnels...now I make an effort to go over, under and in these places to help me...if I have to go somewhere, I go, if I feel panicky, I don't have to stay there, I can leave, nothing is forcing me to stay anywhere I don't want to be, including work. Remember too that people aren't going to laugh at you for having a panic attack, more than likely, if they can see it happening (which is hard to do most of the time), people will offer you help, not laugh at you and put you down.
3. And the best advice I ever got from my favorite T who I can no longer see , and this may sound odd to a lot of you out there, make friends with your panic attacks. When she told me this I laughed, but she was serious. I went home that night, and...sure enough here comes a big one, but wait, I hear her voice, I lay on the couch and conciously said, ok, come big boy, let's have a time. The attack came and went, and on a scale of one to 10, it was a 3...then next time I did this, it was a 1. It helps.

Most of all, find a T that can help you. Your fears are rooted, and yes this is a theme in all my posts pretty much, but they are, rooted in something. If you can dig that out, find out the root cause and work on that, and no just treat the symptoms, you will be so much better off! Sounds like you may need a change in drugs too...not a doc, but I know a few drugs that really help, and ones that work in between in case something happens.

Take it one day at a time, and no you're not alone! I hope your journey finds you well at the end of the day.