It would be interesting to see how to think through building a crawler (as opposed to downloading Nutch and trying to grok it)