Pretty much, yeah.
I'm assuming everyone has their specific experience with this, and certainly how pronounced it is. For me, it's only ever one part/alter that takes over a 'real' voice; the part that 'protects' all the rest. I know it sounds weird, but just go with it

Usually, that voice is angry / scared / aggressive towards things that it perceives to be a threat, incl for example, my therapist. When you wrote "Go away, Stop getting near me. I told you to go away, Stop bothering me etc...", that's
exactly the kind of stuff that part says. It's helped me a lot to recognize why that part is saying those things, then I can think through the real-life situation. E.g., is my therapist really about to abandon me?
Good job for letting those parts have a say! My guess is that they have a ton of important things to share.