Hacker News new | ask | show | jobs
by sabareesh 101 days ago
Sounds like speculative decoding but for KV cache