Hacker News new | ask | show | jobs
by matheusmoreira 15 days ago
That's a much better argument, and one I agree with. Scrapers should be polite and consume the least amount of resources possible, ideally less than what a person would consume by browsing the website normally.