|
|
|
|
|
by tptacek
4001 days ago
|
|
Google in fact does honor requests not to scrape websites, and honors them at Internet scale. Padmapper could, meanwhile, reasonably be defined by their unwillingness to stop scraping a single site whose lawyers made it clear they did not want to be scraped. So I'm not sure your comparison is valid. |
|