Hacker News new | ask | show | jobs
by staticman2 10 days ago
> This behavior is exactly what you'd expect from a model distilled from Claude.

This is not at all what I would expect because it's trivial to change the training data to replace Claude with Kimi. In fact I'd argue it's almost certainly not saying that due to distillation.
2 comments
tristanj 10 days ago
I encourage you to review the links before committing to a position. The writeup on K3's anomalous trans-model identity is very comprehensive.

K3 reproduces Claude's internal model identifier when prompted, something which the real Claude models themselves do not emit. This is highly suggestive that K3 was trained on Claude metadata (API logs, tagged synthetic data), rather than Claude's chat outputs.

And it's well documented that Chinese labs are buying large amounts of raw Claude metadata https://www.chinatalk.media/p/how-to-buy-cheap-claude-tokens...

link
staticman2 10 days ago
For context you just asked me to read a document that starts with:

"Caveat: fully AI-generated research."

And that you quoted or paraphrased directly.

link
glenstein 9 days ago
>This is not at all what I would expect because it's trivial to change the training data to replace Claude with Kimi.

Wait what? The reason you wouldn't expect it is because if it was distilled, it would be easy to get rid of self identification? Is that any less true of a non distilled model? I suppose there's lots of ways to interpret it, but the idea that self-identifying as Claude is affirmative evidence that it's not distilled seems to get the weight of the inference exactly backwards.

link
staticman2 9 days ago
> the idea that self-identifying as Claude is affirmative evidence that it's not distilled

I wasn't arguing that. I was arguing that even if it was distilled from Claude, the distillation isn't why it identifies as Claude. Therefore identifying as Claude isn't evidence of distillation.

Claude has been caught identifing itself as Deepseek:

https://news.ycombinator.com/item?id=47145081

I don't take that to mean it's necessarily been distilled on Deepseek.

Gemini was supposedly caught identifying as Claude:

https://www.reddit.com/r/ChatGPT/comments/1gslm0t/gemini_mod...

I don't take that to mean it was distilled on Claude.

Claude was caught identifying as ChatGPT:

https://www.reddit.com/r/OpenAI/comments/1e34tkr/why_is_clau...

I don't take that to necessarily mean it was distilled on ChatGPT.

link