I know how you feel. I have to be honest with the fact that our lovely hormones play a big role in this. I know this may sound very strange, but look at where you are in your cycle. I know for me, I have been able to pin point my anxiety/panic attacks to coming on the week before I get my period.
I have suffered with Bipolar, anxiety/panic since I was 16yrs. old (20yrs) now and know how discouraging and enraged they can make you feel. Your anxiety could have been high for sometime about whatever is going on, and without anything in particular "triggering" it, panic comes on. Just because you took some Ativan to help ease the discomfort, doesn't mean that you will have to continue for the rest of your life.
Keep your head up