Hacker News new | ask | show | jobs
by rb2k_ 5655 days ago
Do you remember how fast the "toy" was? (pages/second, domains/s, ...) :)
1 comments

Not really but given the terrible hardware/network connectivity , wouldnt have made much sense now.

Because of this thread, I looked through my old backups and I actually still have the code. Should get it working again sometime

are you gonna put up your code ?

It would be interesting to see how to think through building a crawler (as opposed to downloading Nutch and trying to grok it)