Since you're moving in his area, I think there is no way that you can avoid or meet him so you just have to face what happens. I think you have decided already not to reconnect with him based on what has been going on in your conversations. I think you have a good decision. Good luck to you and you may find your own happiness.