Are you concerned that some part of you will "do" something that you will have to pay the consequences for?
Is it a concern about losing time/not being in control of your own actions/not trusting yourself?
Can you talk with your other parts internally? If not, can you speak "to" them to try to figure out your fear, the panic etc?
I don't know if I am helping or if off the path entirely.
I do know we have contact with family and it is fraught with many differences of opinion, memories, knowledge, feelings etc.

I don't believe it is overdramatic at all, in any sense of form. This woman has done things that have traumatized you and different parts of you have very valid fears and responses to that. Its not dramatic, its.... complicated.
I wish I had more to offer that might help.