You have two choices, leave and get on with your life (hard at first but easier in the long run) or stay and suffer for years never knowing when (not if) he does it again, maybe the 'child' will respond next time and you will be dealing with a sexual issue as well.
Trust me the second option will cause you far more pain than the first will.