It sounds like he isn't frustrated per se with listening to you; he is frustrated with your perspective on yourself.

It might be helpful to speak to each other in person about how best to arrange the speaking and listening. For example, maybe you could explain a bit about reflective/person-centered listening. Would that type of listening be helpful to you?