Hacker News new | ask | show | jobs
by hennell 347 days ago
Cloudflare sees a lot of the web traffic. I assume these are the biggest bots they're seeing right now, and any new contenders would be added as they find them. Probably impossible to really block everything, but they've got the web-coverage to detect more than most.
1 comments

They are lying. They cant detect crawlers unless we tell them we are who we are.