Hacker News new | ask | show | jobs
by faeyanpiraat 1629 days ago
How did you manage to crawl the web without any issues?

Did you get any angry letters and/or lawyery threats to stop crawling a specific site?