There is no "have to." You always have a choice.
However, it IS her job to point out that you brought something up and then refused to talk about it. That's typically indicative of something. A better question from her would be "Do you want to tell me why you don't want to talk about it? What are the thoughts and feelings coming up that brought you to this decision?"