What came before him saying this- the context? How long have you been seeing him? That would make me worry too, and it isn't very tactful. I hope he doesn't mean to terminate with you, but more encourage you.