Your kids are still young and hard to handle by yourself, so leaving right now is probably not a good option. You have a lot to work through. Maybe start with communication with him, telling him exactly what you want.

I would not be able to stand the 'thanks honey' not even one time.