
When our SOs do not have steady employment--that in and of itself is a significant stressor and when you have more money it is easier to do little things to get away (for me it was taking a yoga class). I am on disability and have a part time job (only 5-20 hours a week). My husband has been unemployed for a year and a half so I understand a little bit about needing a break but having to work through things without it. My dad was nice enough to fly me home last month but I did not see my family (dad, brother, sister) during 2017. During most of my marriage (30 years)--I have hardly seen them and only visited during Christmas/Thanksgiving only 2 or 3 times during our entire marriage.
I hope your husband can eventually figure out how to provide more support for the family financially. Intentional or not, he is falling down on the job. He will not have the respect he craves from you and your children if he cannot eventually achieve more. That he has not demonstrated his love by contributing more to the household is likely one of the reasons you wonder "Should I Stay or Go". If you think you should go--you need to plan it out.