Hi Glowiebird,
Have you seen a Therapist? They may be able to help you figure out what issues are triggering this. I think that the sooner you try to address the underlying issues or trauma (if any), that may be causing the anxiety/panic, the better off you will be.
Wishing you the best!