Hacker News new | ask | show | jobs
by softcactus 1361 days ago
I always wondered how their initial python web scraper was fast enough to index the entire internet on that old hardware, even given the small size of the internet at the time. I guess the answer is that they had a local backup at Stanford. Thanks for sharing!