I'm not sure if I understand how your potential is draining away. I don't mean to invalidate your feelings though. To me it seems that you are trying different things and exploring your potential.

I'm a writer and an artist. I have to set aside a project fairly often. Sometimes when I come back to it I'm just not in the same head space I was in when started the project. Depending on my mood or assessment I take it in a new direction or set it aside and try something new. It's an adventure.