I had spoken to him the other day and he told me that there was no issue. I didn't go as far as how I felt uncomfortable. If it happens again that's when I'll for sure go into more detail. Or I'll just ask him yes firmly and say his name if he does that blank stare again. No worries.

It's best to prepare for the worst and hope for the best. <-- Words of an optimist.