I think once you recognize that everyone behaves in a manipulative fashion in one way or another--that is, they do certain things in an effort to provoke specific reactions in others--and that manipulation is a normal thing, you have to also recognize that the word "manipulative" to describe an action is not necessarily meant as a negative moral judgment. It's just a description, and whether it is correct or incorrect, it is not an insult.