Y
Hacker News
new
|
ask
|
show
|
jobs
by
alightsoul
3 days ago
I would figure it needs a lot of kV cache and context size which can be much bigger than the model itself