Maybe there is some reason he felt his chair needed to be moved. Possibly he bumped into it and pushed it 'out of place' when the previous patient was leaving, or something like that. It sounds like you are assigning some particular meaning to his pushing the chair back. Why not mention it to him to see what he says?
I miss moments like that too, when I'm taken by surprise.