Hacker News new | ask | show | jobs
by tacitusarc 11 days ago
But attention/KV cache is the heavy bit in long context lengths which is what everyone needs…