How might you fend him off so as to avoid all interactions with him?

My take on why he is both loving and abusive: He is loving in a manipulative way, he hopes to get you back. But even so he can't hold back his narcissism--he can't tolerate anything that questions/challenges his ego--and so he is compelled to defend and attack when that ego feels threatened.