I wouldn't presume to judge this whole situation but this one thing sounds really obnoxious, as if he is saying you are totally selfish. For expecting to be listened to in a difficult moment? You didn't know in advance that the session was going to lead to this kind of moment, and he should have had the judgment to know that he can call his contractor later.

It's possible he stepped out because he just didn't realize how upset you were, but in that case it should have been a sincere apology.