You assume that the person who does this is all together and therefore what he does must make some sense! Well, it does make some sense, but probably not the way you want it to. I see it as just a person saying something that is true for him, that he finds you difficult sometimes. He is not handling that well, and you see that as a threat, rather than as a simple statement of his shortcomings. I guess you do not want to see that he has shortcomings. Because if he does, how can he help you???

At least, looking at how I react, that is how I interpret it. Because I tend to react the same way and have to work hard to see what it all means...