[immibis]

Because we're a post-competence society. Very little useful data will be gained by the operators of these bots. They don't work, and nobody cares they don't work. We're doing everything cargo-cult now. We're building giant machines that do nothing but spew smoke into the air, because that's what they did in the Industrial Revolution and it brought prosperity, didn't it?

[walterbell]

Hopefully any actual scraper bots are writing data to de-duplicated cloud storage. The rest should be served with Anubis, PoW or other DDOS defenses.