Hi, ckoeber, "which" family member is unstable, the person visiting or being visited?

I would just say I don't feel well enough/comfortable having visitors at this time but would love to continue talking to them on the phone/in email/texting, etc. and maybe later visit them (where you can control the visit better).