Don't invite them over and take separate cars when you go out. I have friends and one neighbor like this and it has worked okay for me.