[AtNightWeCode]

Not sure where you coming from but let us go back 10-15 years when there was an open market for commercial crawlers and IP ranges to be used for it. You sold shoes and scraped all other competitors for instance. That era is over.

For legitimate interests today including search engines and services for price comparison that data is often provided for free.

There are design patterns used today that does among other things provide incorrect prices to scrapers.

Scraping is illegal in most western countries btw.

[ricardo81]

>For legitimate interests today including search engines and services for price comparison that data is often provided for free.

Can you explain that further in the context of search engines, new or existing, need to crawl websites and Cloudflare are a barrier to entry? You seem to contradict yourself.

>There are design patterns used today that does among other things provide incorrect prices to scrapers.

If you say so, and hopefully they do it 100% correctly.