It does make sense to me
I’m not the best at advice. For me personally, I wish I had left all the abusive relationships I was “in” much sooner. But your SO doesn’t sound like any of those abusers (although I do recognise a pattern that some of them had)