This angers me how some 'people' can get away with it. Pfft, so much for justice...
Is there any way your girls could express how they feel (as in, they don't want to see / are afraid of seeing this 'man') to a judge or something? Maybe this could have some weight? or get child protection services involved?
Sorry, not sure how it works, i just hope it all works out for the best...