It's hard to say without more details but maybe he is pulling away coz he has issues with avoidance, socialisation, believing someone can really love him? I'm the same, always pulling away or pushing away. I'm sure you've done nothing wrong.

((((FeelingSad))))