Hacker News new | ask | show | jobs
by m3h 15 days ago
> Kimi K3 is Kimi’s most capable model to date, with 2.8 trillion parameters.

This puts them on the top of the largest open models list:

  Kimi K3            2.8T
  DeepSeek-V4-Pro    1.6T (49B active)
  Kimi K2.6          ~1T (32B active)
  GLM-5.2            754B (40B active)
  DeepSeek-V3.2      685B
  Mistral Large 3    675B
That's one mighty large model! Moonshot is going to need the USD 500 million reportedly raised earlier this year to run this model.
8 comments

Crazy how mighty GLM-5.2 is at less than a third the parameter count. Z.ai really cooked with that one.
I was just looking at the same thing and how flawed it is that we tie parameter count with "intelligence". GLM-5.2 is my go to day to day model because of how darn good it is. I had no idea it had a substantially lower parameter count over deepseek v4.
> USD 500 million

There was an another around after that . Moonshot raised $2B on a $20B valuation in May - https://techcrunch.com/2026/05/07/chinas-moonshot-ai-raises-...

I guess it remains to be seen whether this will be open-weights. We don't even know how many active params at this point.
The article says weights will be released in the coming days, and hints it's likely around 50-70B active params.
It did say that, but it doesn't any longer.

  The full [Kimi K3] model weights will be released by July 27, 2026. Further details on the architecture, training, and evaluations will be released alongside the Kimi K3 technical report.
https://archive.vn/KBzXr
They are still describing it as open source:

> Kimi K3 is the first open-source model to reach 2.8 trillion parameters.

https://platform.kimi.ai/docs/guide/kimi-k3-quickstart

Nice, they updated it again
What's the URL of the article that used to say that?
https://platform.kimi.ai/docs/guide/kimi-k3-quickstart this one, it used to have more information about the model itself, similar to the K2.6 and K2.7 pages.

Edit: OpenRouter still describes it as an open-weight model: https://openrouter.ai/moonshotai/kimi-k3

Guess we'll see!

That's a quickstart page for using the model on the platform not a page about the model. I am skeptical you are correct that it said something about model license earlier.

Edited: I was wrong.

The K3 marketing popup when I look at the Kimi Code page says "Kimi K3 Open Frontier Model". So, if it's not going to be open, they haven't told the whole team, yet.
Open like OpenAI, maybe.
Ling/Ring 1T-A50B and the new Inkling 975B-A41B deserve to be on that list.
> on the top of the largest open models list

Moonshot (true to their name?) has always lead in terms of releasing the largest among open weight LLMs.

> Moonshot is going to need the USD 500 million reportedly raised earlier this year to run this model.

Think Moonshot, as a spin-out, can expect backing from its former parent, Alibaba? I don't think they would be particularly worried about finances, if the Kimi K series continues to outperform the Qwen Max series (which seems to be the case; while Kimi is also super popular in China).

How many parameters do the top closed models use?
Fable reportedly use 20T paramteres, 1T=1000B. Opus is probably 10T. That said, these are estimates based on model preformance and scope of general knowledge breadth.OpenAI, Anthropic, and Google have not openly report their model sizes.

Chinese models are way behind on the mode size race due to lack of abudent AI infrustructures. That said, it seems Chinese models are going pretty well on a seprate route. They manage to achieve 80-90% performance with 1/10 of the model size. This is some what related to the diminishing reward situation described in the scaling law. I think it can also be attributed to their persistent research in this direction. Thinking and DSA (deepseek attention) were both developed and opensourced by Chinese labs then adopted worldwide.

I wonder if we're a 5-10 years from running this on beefy consumer hardware, or more like 20+ years.
Kimi has almost no advantage over Zhipu (Z.AI), so the performance boost likely comes from the number of parameters. The 2.8T model may not be as large as Fable, so Fable’s performance may also stem from the number of parameters. Or perhaps they quickly distilled Fable or Mythos. Distilling Mythos has a significant barrier to entry, and since Fable was released not long ago, is this even feasible? It outperforms Fable in several tests—how did Distilling achieve these results? Is this some kind of cross-vendor RSI (Recursive Self-Improvement) or RDI(Recursive Distillation Improvement)?