Hacker News new | ask | show | jobs
Crawlers impact the operations of the Wikimedia projects (diff.wikimedia.org)
13 points by manuelfcreis 439 days ago
1 comments
anotherpaul 439 days ago
Seems like a serious issue many sites have nowadays. I really don't want this solved by Captchas everywhere.
link
Handy-Man 439 days ago
If it comes to it, just block all known IP blocks of cloud providers.
link
thcipriani 439 days ago
There are likely a number of beneficial bots[0] running from cloud providers. And residential proxies are also widely available for very determined scrapers.

[0]: <https://stuartgeiger.com/talks/2013-08-03-wikisym-levee-brea...>

link