Hacker News new | ask | show | jobs
by rosha 2818 days ago
I am currently using https://www.npmjs.com/package/proxycrawl web scraping system that offers anonymous scraping too. But they do not have a Go library yet. Does the system support anonymous scraping too like over a proxy? I'd love to use it if I can scrape URLs with proxycrawl API like with this example: https://api.proxycrawl.com/?token=DsFuFiigAZ2Wm6U1BPh7Zw&for...
2 comments
ziflex 2818 days ago
Proxy support is not in place yet. I will add it in future releases. You are welcome to do a PR :)
link
megous 2818 days ago
Token?
link
rosha 2818 days ago
I do not use tcp token, so I could share it for free, i use the api for javascript token which gives me dynamic content more.
link