yea, you probably do need more conversation about it. I just hate that this mostly played out in email though. Email and Text are the worst way to straighten things out, you can't hear the inflections in someones voice or read their expression when you respond. The convo stays one sided for both people. My best advice would be to not address any of it via email, to refrain and only discuss in person...I think that would cut thru a lot of misinterpretation for you and him. Email is great for updating, or expressing painful thoughts, but not for debating.
Good luck MUE...I really hope it all works out well.