I'm sure, the comment about how he fed you is just a small example, of an entire bigger picture.
He's had affairs on you, putting your health at risk, never mind not attending to how this would affect you emotionally, you know, the woman that HE vowed to honor. Sounds like he broke that vow.
It's not easy, but gosh, the relief of not being subjected to abuse day in a day out is well worth, whatever struggles you may encounter. Plus, your child doesn't need to grow up in an argumentative home.
I get what you mean, about depression. Yet, being away from a tumultuous relationship, makes any level of depression, just a little more tolerable.