Hacker News new | ask | show | jobs
by mike_hearn 311 days ago
They cache the intermediate data (KV cache).