Hacker News new | ask | show | jobs
by sabareesh 54 days ago
Sounds like speculative decoding but for KV cache