You backed away from the cliff because you knew there was a good chance of getting hurt or worse. Is that cowardly? I think not. I call it wisdom. Too many times we ignore the danger of our choices and then have regrets.
Climb the cliff. Enjoy the view. But don't step off. Self preservation is a good thing.