I have one album, five pictures, so just messing around with it; I clicked on the album (the link next to the cover picture); then on the far right side I chose (in the long blue bar) edit pictures; there I could put a check in the box under the caption/image name that says "delete this picture". After clicking save changes under all the pictures--wahlah, now I have four pictures. I hope these instructions help.
Also, is the picture you are trying to remove designated as an album cover? You might have to deem another as the cover in order to remove it.