Hacker News new | ask | show | jobs
by alightsoul 3 days ago
I would figure it needs a lot of kV cache and context size which can be much bigger than the model itself