Hacker News new | ask | show | jobs
by m463 457 days ago
I kind of suspect some of these companies probably have more horsepower and bandwidth in one crawler than a lot of these projects have in their entire infrastructure.