Is it possible for it to be coincidence? That he just happens to be looking your way before he starts an activity? It's just a thought though it does seem a bit odd for it to be the same guy. Since you have not seen his face regularly is it possible that it isn't the same person but just seems like it? Just askin'.