It is totally reasonable to feel anger for being neglected, and I'm sorry you had to go through that.
Do you have a therapist that you can work through this with? You are right, you can't stay stuck in the anger...it will prevent you from moving on with your life.