I am sorry you are struggling. He sounds like bad news really. He comes and goes without as much as saying good bye. It's rather mean. I'd start looking for ways to move on
And not allowing him back into your life. Hang in there