[AYBABTME]

Not long, perhaps 2h for the core and then some cleanup over a few hours as I cogit about it? This was my submission back in 2014 https://github.com/aybabtme/crawler/commits/master