Its a slippery slope. You have to defend yourself at the first poke, to let them know they cant take that path with you anymore. It takes being just a little more assertive than you are probably used to. I would rather be a nice sweet person - really! - but other people will just drag you away then. You dont have to be mean, just dont argue. Or cut the conversation short. Draw a little boundary.