I think if someone is known as a manipulator, they are not that good at it.

It sounds like right now you are not too bothered by his actions, but in time you will resent it. Do you want him treating any children you may have together one day in his manipulative way?

If you get along with him, and he is manipulative, but with good intentions, then just accept it.