As a child abandoned by my mother, I cannot condone you leaving your children. But, let me say this: There is a difference between just up and leaving and not caring about them, and not being able to take care of them and making sure they are with someone who can and will take care of them. I fully understand how you feel, as I raised 3 single handedly and had another that I was not able to care for as I wanted to. (When I say care, I mean physically take care of).
Certainly your mental health is important and you need to take care of yourself before you can be what you need to be for your family. If leaving is what you need to do, please make sure your kids know you love them and want the best for them. I can tell you from experience that not knowing if you are loved or not is the worst thing to a child.
I hope you find peace and things turn out well for you and your family.