wow....who is this person? do you like him or her? Is it a prospect partner?
you are not really clear at all...
I would tell him that I would appreciate a short notice before getting to my home and I would tell him in a good manner....
You don't have to have people at your place when you don't want them!