Your son sounds like he struggles with the psychological abuse he suffered from his mother. Even though he is big and strong now on the outside, he has a very troubled child part in him that still suffers. He has a right to completely distance from his mother and it’s understandable he wants you and his sister to be safe from potential abuse.