I would take it at face value. He's letting you know the downsides of the job in case that's not the kind of thing you'd want to deal with. But maybe there was something in the way he said it that made you think it was directed towards you?