Hacker News new | ask | show | jobs
by holstvoogd 1812 days ago
If your scraper behaves, perhaps it would not be blocked…
1 comments
r_singh 1812 days ago
Not really, most popular websites block any requests coming from curl
link