Hacker News new | ask | show | jobs
by pella 23 hours ago
The future may be ~ AI-assisted format detection + OpenZL

(~ OpenZL-AI-LLM recognises the data structure, then guides OpenZL toward the best lossless compression path )

2 comments

  "The unreasonable effectiveness of our first foray into training leads us to believe that the graph model is uniquely  positioned to facilitate ML-guided generation of compressors. We are tempted to view this as “the next big thing” in production-scale compression. Whereas compression research has up to now eluded those without domain expertise, we believe the future of application-specific compressors will be unlocked via investment in automated learning methods."
https://arxiv.org/abs/2605.09928 [11 May 2026] OpenZL: Using Graphs to Compress Smaller and Faster
1. Upload data using conventional compression method (or uncompressed)

2. Spend orders of magnitude (literally) more on compute to run the LLM on the data than any compression algorithm would ever take.