Hacker News new | ask | show | jobs
by mellosouls 1116 days ago
I doubt the objections are about scraping per se, but about unethical scraping where no consideration is given to etiquette.

"proxy rotation" in the first line does not bode well for ethics.

1 comments

What's wrong with proxy rotation? Big Tech attempts to prevent any scraping of their content whatsoever. In the context of that web, proxy rotation is table stakes.
Without any documentation about how etiquette will be respected and sites won't be hammered, it's fair to be sceptical about the ethics.

Not every crawled site is "big tech" or even commercial.

I don't disagree, but I also don't think "proxy rotation" immediately implies sites will be hammered either.
Fair enough. I may be too sceptical. But I note the OP has ignored prior comments instead of taking the opportunity to clarify. It doesn't reassure.