Honestly, it sounds like Robert has his own issues which doesn't help matters.

That's why I say to do pro's/cons and it will give you a better perspective on where to go with your relationship. Even if you choose to part ways.. Time does heal wounds, and maybe things will be different.