Hacker News new | ask | show | jobs
A Change to Common Crawl Dataset Size Reporting (commoncrawl.org)
3 points by ccgreg 72 days ago
1 comments

Common Crawl is switching to reporting dataset sizes in nibbles. As an organisation dedicated to data preservation, we feel it would be remiss to allow this underrepresented unit to fall out of use. Our latest crawl now exceeds 689 tebibbles. Common Crawl Foundation