That's why it all works!
I think reassurance is a very wide term that can cover a lot of different behaviors. But what keeps the lack of reassurance from being cold is that it should be happening within a framework of being securely held in the therapy.
If you think about it, IRL reassurances often have the effect of pushing someone's concerns away and ending the engagement, rather than supporting the need.