Hacker News new | ask | show | jobs
by jboss10 12 days ago
I think the "architectural features" are part of the model, not the kv cache. So implementing it would be difficult and expensive.