Hacker News new | ask | show | jobs
by mateuszbuda 1009 days ago
Some parts are outdated now. Bot detection vs web scraping is an ever evolving arms race.

Anyway, incolumnitas blog is a great source of information about bot detection and techniques to avoid being detected. We have implemented many successful methods based on it in https://scrapingfish.com/.