No one can come visit you without your permission generally. I'd just tell them what you told us. You need the alone time right now; it's no reflection of anything other than that. I completely understand that feeling. I was glad that my only visitor was my husband, and even he understood if I asked not to come some nights.