Hacker News new | ask | show | jobs
by gabipurcaru 949 days ago
> people only do it when there's no API

Legitimate scrapers, maybe. Everyone else does it to circumvent the API limitations, by posing as real traffic. APIs imply API keys which can be traced and banned.

2 comments

Well, that's what happens when you make the API more limited than what people can do with scraping (or with using the public "our own web client" API key).
And what makes a scraper legitimate?
Legitimate scrapers adhere to the websites terms of service, for starters.
In the case of GP, I believe they're referring to legitimate intent of the bot owner.