Hmm, that is a tricky situation. Often when people feel judged and insulted and held in a negative light by someone it is very difficult for them to feel "warm" towards the person that has insulted them. Even in professional relationships.
I can hear you say you want them to feel warm towards you rather than indifferent though. It sounds like this person anticipates further attack by you.