My T usually doesn't say time is up. He has lately though because I haven't been paying attention. When he grabs my folder to write whatever he writes, that is a sign that time is up.

One of us gets up first, usually he does, and he opens the door and out I go.

I wouldn't worry, you were being polite.