This is only a thought, I'm not sure if it applies in this situation, but, I'm thinking about some of the times I've pulled away from others in the past. It was painful for me as much as them but I'm sure they never knew that.

Sometimes people pull away to discourage over-dependence, and, to encourage independence. Or, maybe he's just mixed up himself and doesn't know how to express what he's feeling.