Since I'd never tried posting anything in the galleries, I had to check it out. Under each picture that I've posted is a row of options including... Edit Photo.

That, in turn, offers the option:

If you want to delete this image completely, check this box [ ] (CAREFUL - once it's gone it's gone)