This is kind of a strange thing to say randomly and not in response to something. Maybe there was some kind of context that got lost once you heard him say it? I would definitely ask him outright what he meant so you can have a clearer picture of what he meant.