Hacker News new | ask | show | jobs
by Avamander 634 days ago
Oh you will not notice. The pages can easily be spread out between residential IPs using headless browsers (masked as real ones), unless you really pay attention you won't see the ones that want to hide.
2 comments

Every single argument against Cloudflare's features highlights exactly why people use Cloudflare so much.

You're talking about people setting up a botnet in order to scrape every scrap of data they can off of every website they touch. Why on earth would anyone be okay with such parasitic behaviors?

That's the thing, CF ain't gonna protect you against that. You need to consider actual access controls to actually restrict access.

Otherwise you're blaming people of using the data you've published, so what if they do?

How many scrapers are sophisticated enough to go this far though? Most of them are probably of bad quality and can be detected.
Why would those sophisticated enough to go that far, be of low quality