Hacker News new | ask | show | jobs
by dgan 41 days ago
Industry really went from "prove you are not a robot", to "but also if you are, this way please"
3 comments

This is Cloudflare. They have an extremely strong incentive to increase bot usage. If there is no bot scrapping the internet they'll be out of business.
I've been using cloudflares remote browser api to bypass their own WAFs for my scrapers for a while, their products and services have been wildly contradictory for a while.
This particular example is not contradictory if you think about it, its essentially a protection racket.
I hate that I never considered this before.
About goddamn time. The recent past consisted of discord blocking me because their telemetry was broken and exceeded their rate limit and target blocking me because two devices in a single household look really suspicious.
I mean, Cloudflare will help website owners ban scrapers unless they pay. It’s kind of what they do.