I just went through this! This time I drew up a contract, checked his background and I have a keyed dead bolt on my door and keep it locked when I'm not in it. I insist he do the same.
But this guy is waving some big red flags and I suggest you get him out ASAP. For your own safety and peace of mind. Living with suspicion and tension is no way to live.