You haven't been treated well. He is tired of you not forgiving him? Yet he's out all night, etc. That sounds illogical that he'd expect that....I would not hesitate in moving on, if I were in your situation.

Children are resilient and adapt to divorce if you keep them out of the process, let them be kids. I wish you the best in whatever you decide.