Hacker News new | ask | show | jobs
by snehesht 3902 days ago
No offense but ...

First thing, it's just a suggestion. Don't use duplicate account to reply to the comments. Do it from your original account.

I think what the user "chdir" means by wrong is that you're not honoring "robots.txt" and how do you account for ethical scraping ( eg. running 50 concurrent connection on a single website and overloading the website, technically its DoS attack)