Wait & see is always a good option.....if he turns out to be a bit obnoxious later on, then you can deal with it then.....maybe he has interpreted your silence & it won't be necessary to say anything.

Hard to say how people do interpret things.....seems guys are all so individually different (& yet similar in irritating ways also). Hard to know sometimes so best solution is to play it by ear & react appropriately when the need arises.