Hacker News new | ask | show | jobs
by tptacek 4001 days ago
Google in fact does honor requests not to scrape websites, and honors them at Internet scale. Padmapper could, meanwhile, reasonably be defined by their unwillingness to stop scraping a single site whose lawyers made it clear they did not want to be scraped. So I'm not sure your comparison is valid.