Hacker News new | ask | show | jobs
by fancyfredbot 28 days ago
Normally people refer to the compute-bound phase as "prefill". Nothing wrong with saying it's building the kv cache though, it's accurate just unusual.