Is that comment made AFTER a conversation you have had with them so they are responding to a feeling of being unsatisfied with yourself message they are receiving from you? Usually people don't make a comment like that unless they have received a sense that you are unhappy with the way you are.