Hacker News new | ask | show | jobs
by tir 514 days ago
>the law explicitly allows scraping and crawling.

Nepenthes also allows scraping and crawling, for as long as you like.