Hacker News new | ask | show | jobs
by brechin 4931 days ago
So, would that detection mechanism be able to deal with a number of coordinated scrapers rotating through lists of proxies, using different User-Agent strings, making requests with (pseudo-)random delays between requests?
1 comments

yup, read the paper