Y
Hacker News
new
|
ask
|
show
|
jobs
by
xxpor
12 days ago
It's funny, because LLMs have context switching costs too! Cached tokens cost less than non-cached. There's no reason to think that doesn't apply to humans.