Hacker News new | ask | show | jobs
by m_ke 264 days ago
Yeah we had to roll through a bunch of proxy servers on top of all the other tricks you mentioned to reliably download at a decent pace
1 comments

What are your thoughts on the load scrapers are putting on website operators?
What are your thoughts on the load website operators are putting on themselves to block scrapers?