Hacker News new | ask | show | jobs
by p49k 3074 days ago
This approach only stops the most basic and laziest scrapers. Some people have tens of thousands of diverse IP addressed to utilize for scraping. Many of them will not give a shit about your bandwidth or server constraints and will cause your server to hit bottlenecks, making it slow and useless for everyone.
1 comments

I guess the best approach would be to captcha everything until we've captcha'd ourselves back into dial-up times for content delivery. /s
You ever used tor lately?