Hacker News new | ask | show | jobs
by prolways 4575 days ago
Isn't this wildly illegal? I thought all web scraping violated CFAA... not to mention copyright...
2 comments

In many cases how is it different from visiting each page and printing/saving the html? It's useful to create a backup of the site[1].

I'm not saying it's good or bad. It could be used for both. I know at my previous job we used it (a bit shady I think) to scrape and compare competitor prices to ours.

[1] Though I can't understand why you'd want to backup your own site but I am pretty sure I've heard of it being done.

> I thought all web scraping violated CFAA... not to mention copyright...

I hope this doesn't apply to meta tags and outbound links otherwise one of my projects just got a lot more awkward.