From what I see, he is going to have to forgive you. Even though, he says understands that you thought you loved you ex when you did these things with him. He is still not over you having had another relationship before him. I would suggest couples counseling. I think that is the only way to bring out why he is so insecure about a past relationship you had prior to your relationship with him.