Y
Hacker News
new
|
ask
|
show
|
jobs
by
fancyfredbot
28 days ago
Normally people refer to the compute-bound phase as "prefill". Nothing wrong with saying it's building the kv cache though, it's accurate just unusual.