It could be that you feel inadequate to care for others, or the kittens represent yourself, your 'inner child' who you maybe feel you abandoned or let down, or any other people you feel guilty because you believe you abandoned them.
This doesn't mean you actually are guilty or have done anything wrong but that could be what you feel deep down inside.
I don't know anything about your situation so I don't know if any of this holds any value