I'm not sure if he can track my address or not.

That's kind of scary to think about. I live in a small town though and he knows the town I live in. He even made a joke once that he was going to "come visit me in my hometown" without us planning to meet here.