Hugs, Artie, I'm sorry. That was really wrong of your H to say to you.
You're doing awesome, particularly your work on yourself. It would not be heartless to leave now, either, as he's getting treatment and having success with it. It's not like he's terminal. You need to do what's best for you.