Great plan!
That time for the two of you alone is a healthy plan.
Is it possible for there to be some "family time" ground rules re: what types of behaviors are fine for inside the house, as you also have neighbors on your mind? Simple rules, like: no slamming doors, etc.? Children tend to do well with consistent expectations communicated clearly to them.
Maybe you bf needs to step in a little sooner with the children when you are struggling? Maybe share a code word or a specific gesture where you communicate your need for him to intervene asap?
You are a kind-hearted person. You may simply need a break during more difficult times.

WC
PS Slamming door irritate me, too. It can feel very jarring, very agitating to me at times.