Unless you've already done this, put that same message in writing and mail it to your contractor with a note stating 'A copy of this letter has been forwarded to my town's police department "for consideration"'.
Having informed the police in writing, if more complaints arrive to the police station from other disgruntled clients, then the police could take action and the contractor made aware he could be prosecuted.
Well done for asserting yourself. You were courageous.