I would tell him that you will separate from him if he does not stop distancing himself. He needs a wake up call and it should come from you...