First off, stay off Facebook with coworkers. He doesn't need to know what is going on in your personal life. This "friending" and "unfriending" sounds really childish. If I knew two of my co-workers were wasting time on this it would definitely be a negative for a better job or recommendation.