They can't haul you from your home unless you're a danger to yourself or others.

There's also no way your doctor could have discussed your case with your family. Your family can see the same things your doctor can see. You might think you're hiding things from your family, but people are never as good at hiding their problems as they think they are!