Sounds like he is projecting his guilt on you and twisting things around to blame you for his failings.

Don’t engage him when he does this.