[culi]

I'm not sure if corporations will be willing to allow LLMs to go the way of EVs.

Then again, all of Chinese models are open. And DeepSeek even publishes research papers alongside their models that go in depth into the methodology. I guess there's not much stopping USian companies from copying

[wolttam]

DeepSeek isn't the only one publishing; Kimi published about both their Attention Residuals and KDA / sparse attention.