I think its very natural for you to feel this way. I understand how you're philosophy is to love, but you are human, and its completely understandable how it would be difficult for you to still love him given how much pain he has caused for your family.
In time he will understand what he has done, and if he has a little bit of human left in him than he will feel humility.