|
|
|
|
|
by dzaima
158 days ago
|
|
Old scrapes can't have data about new things though; have to continously re-scan to not be stuck with ancient info. some scrapers might skip out on already-scraped sources, but easy to imagine that some/many just would not bother (you don't know if it's updated until you've checked, after all). And to some extend you do have to re-scrape, if just to find links to the new stuff. |
|