|
|
|
|
|
|
by rayascott
2520 days ago
|
|
|
The author attempts to contrast web scraping and web crawling and gets it very wrong. This is what it actually is: web scraping - I download the content of a webpage or select webpages, web crawling - I download the content of the entire internet (or part thereof). How he can say that someone who's crawling the internet and building a search index with the contents of the downloaded data isn't also scraping the web, makes no sense. |
|
|