I don't know you, but from the way you talk, you may have BPD. It causes anxiety and depression and one of the main traits is abandonment issues. It is highly underdiagnosed, and the way your memory works with hating things that you associate badly in your memory is also connected with it. Can't hurt to check it out and see if it seems to fit.