I think counseling would be worth a try. As you say, it sounds like you two really need some help. If he will not go, then perhaps a few sessions on your own could be helpful.

That said, it does sound like he has a lot of issues. The rubbing the one night fling in your face would probably have been a deal breaker for me. I think that was a mean thing for him to do.