Hacker News new | ask | show | jobs
Speculative KV coding: ~4× losslessly compressed KV cache using a small model (fergusfinn.com)
2 points by somnial 42 days ago