Well, I don't know wht you two have talked about precisely (not sure what does he mean by "you didn't care about me" tbh) but if he gave you reasons, and those reasons seem valid to you, then why did you stop talking?

Now that you know the reasons, it should be easier to start over.. right?