So I ended up texting him, and he said "No worries. Just an observation. I'm also just not quiet, haha." So maybe he doesn't care and I was freaking out over nothing. I'm glad I let him know though.