Hmm...I'm thinking that he cares quite a bit about you and it made him feel a lot of compassion, pride, and a sense of closeness with you that you would trust him and believe that he is on your side even when you are struggling and could easily interpret his actions as uncaring and rejecting.