Move on, for sure.

Even if you loved him less than he loved you, it would not be a crime. there would not be any fault involved, because you (or anybody else) cannot will your feelings. It is not, say, "accusing somebody of habitually failing to take out garbage until vermin appear in the garbage pail".

He cannot accuse you of loving him less than he wants you to love him, or, loving his less than he loves you. A person can be SAD when his partner loves him less than he loves his partner (in reality or in his mind, matters not), but that is all. Just SAD. If he starts accusations, move on.

On a more general note, a person should be able to enjoy giving love without being reciprocated for it fully, eye for eye, tooth for tooth, hand for hand, foot for foot etc. He is unable to do that. Whether his "accusation" is true is actually irrelevant - that he MADE the accusation already reveals that he expects eye for eye, tooth for tooth, hand for hand, foot for foot etc., and that is not very nice and not very altruistic.

So, no point.