Hacker News new | ask | show | jobs
by krsma 581 days ago
Hi, creator here.

So our open-source version does not provide cloudflare bypass or captcha support. It is impossible to have a robust system for the same completely FOSS. But we do have it available in our cloud version (which we launch soon, currently in testing). Our open-source version allows you to BYOP (Bring Your Own Proxy) to handle all the bypassing. Our OSS version is being used by users with small to medium scraping needs :)

1 comments

That makes perfect sense, I know from experience that things like Google Trends scraping is an absolute pain in the backside and requires a lot of jiggery-buggery in order to get around their bot detection — a proxy alone will do nothing to bypass them due to the mechanisms they’ve implemented.