Hacker News new | ask | show | jobs
by JamesGreene 2344 days ago
With the way web hosting servers are set up, and specific companies that sell this hosting, bandwidth for crawling/scraping is basically $0 at most popular companies.