|
|
|
|
|
|
by finnthehuman
461 days ago
|
|
|
For that to work, a website has to push a mirror into that alternate system, and the scraper has to know the associated mirror exists. That's two big "ifs" for something I'm not aware of a standardized way of announcing. And the entire thing crumbles as soon as someone who wants every drop of data possible says "crawl their sites anyway to make sure they didn't forget to publish anything into the 2nd system." |
|
|