It sounds to me like you've got so much going for you and you have dodged a bunch of bullets getting out of bad relationships.

Trust your own instincts.

This last guy sounded abusive.

Maybe your mistake is getting too intimately involved before you really know what the guy is like. Look more closely for those red flags and keep listening to yourself.