Instead of seeing it as "now I have to leave because he did something wrong" what about talking to him about it? Can you bring it up and together create a better plan to help you? Maybe spending the last 10-15 minutes grounding and bringing you back to reality, and if you still look like you're struggling, him agreeing to call you that evening?