I think when we have an "old" life and a "new" life, having contact with people from the "old" life can make us feel too close to that old life. That may not be right for you and your friend, but I have noticed it with me and an old friend.