Y
Hacker News
new
|
ask
|
show
|
jobs
by
Haeuserschlucht
295 days ago
20 minutes is a huge turnoff, unless you have it run over night.... Just to get the hint that you should exercise self care in the morning when presenting a legal paper and have the ai check it for flaws.
1 comments
anuarsh
294 days ago
We are talking about 100k context here. 20k would be much faster, but you won't need KVCache offloading for it
link