Maybe it's not fun for him, maybe it's his way of showing you that he's angry at you? I don't know.
((((((Inny))))))) I really don't think he's enjoying making you feel the pain. If he does then you have to leave him, which I really, really don't believe is the case. Do you think so?