I also say "I don't know" a lot to the therapist and my husband (though I've learned not to say it as much to my husband as it annoys him). But for me, it's not usually because I can't think, it's because I can't decide on an answer.