I think you are on the right track, and that the psychological effect would be a feeling of abandonment, lack of nurturing, etc.
I would look for books about abandonment or even better (to me), books about attachment.
You might also consider books about child development.
I hope this helps