I think that no one is in the position to tell someone in a relationship whether they SHOULD NOT or SHOULD be together. You do not know their background, experiences or what they have gone through together.
Suggesting that a couple take a break may bring them closer or break the relationship, given that there are already negative feelings now. And if the guy has abandonment issues, it is the most painful thing that you can do to him.
He suggested couple therapy. That is a positive start. Why refuse to even give him that chance to make things better?
Bottomline is, do you love him? Do you think he loves you? If he has personality issues due to some stuff from the past, he is ILL. It is his illness that is causing pain for BOTH of you. He is in pain too, or he wont be affectionate to you again. Understanding and support for his condition goes a long way.