There is no love there. He is manipulating you into believing he is a kind caring person. People who go from kind to angry in a second are one you don't want to be around too long. They have "their own" personal problems to deal with.

Think about it this way those words that come out of his mouth are his own internal thoughts not yours. You need to think before accepting what another person says. If it's true accept it and change it if you want. I can see that from the words he is saying is because he doesn't forgive his past and he isn't helping you any better on forgiving yours.

Leave him and help yourself.

I myself have been taking things too personally. Though then I think later how was it true what that person had said; they are only accusing me and making assumptions.

This may help some plus there is a book:
» Four Agreements and Wisdom for Spiritual Warriors based in Common Sense

Also read on how to become more assertive; they have some really good books out there. Like this one: When I Say No, I Feel Guilty: Manuel J. Smith: 9780553263909: Amazon.com: Books

These help bring more happiness to life. Forgive your past and strengthen your future to come.