After working through college with a data company and witnessing round one of the 'crawler', spider technology. ..I'm sceptical

It was, in my eyes, a how dare them, moment. Who sold what list and where?