Hacker News new | ask | show | jobs
Show HN: Now tracking the number of unique URLs in the Mwmbl index (mwmbl.org)
1 points by daoudc 811 days ago
This is actually a lot harder to do than you might imagine, we need to scan the whole index and use a hyperloglog (handily implemented for us in Redis) to count the URLs.