I told my other T. She said that boundaries are influenced by a lot of things, including culture, your level of emotional intimacy with the other person, your level of comfort with intimacy in general, etc. She also said it's absolutely fine for me to decide what my boundaries are and that I have a right to express them and have them respected. She told me I should have the conversation with this other T about it, if for nothing else then for me to practice learning to stop avoiding things.

She doesn't think I should just never go back.
I am going to go, and take a note in with me that says my concern on it in case I can't talk when I get there. (Every time I've tried to say something, I couldn't. It's almost like I don't even have a voice). I'm going to tell him my concerns and see what his reaction is. I'm leaning toward terminating with him anyway, but then at least I will have spoken up for my self, and not avoided speaking up like I always have in the past.
Wish me luck pls