Maybe when you told him that he was insensitive for not saying he was going to miss you while he was gone, something clicked for him.

I don't think you should read more into this than he said. He cares about you but thinks you deserve someone who cares more than he does.