Hacker News new | ask | show | jobs
by lifencoder 2988 days ago
"Also, is there anyway to prevent website from scraping content?"

You can implement a cloudflare dns so that people(or bots) are not able to scrape your content. even you can have robot authentication checking methods like google recaptcha to prevent scraping of content.

1 comments

>You can implement a cloudflare dns so that people(or bots) are not able to scrape your content. even you can have robot authentication checking methods like google recaptcha to prevent scraping of content.

There are entire captcha farm industries dedicated to 'automating' the filling out of captchas using mTurk and similar crowdsourcing services for nearly nothing,to say nothing of exploits for the captchas themselves.

Nothing can be done to prevent the scraping of web content, at all. If a site can be loaded into a browser, it can be scraped. It's just a matter of the result being worth the effort.