Without a massive amount of post-training, it will be obvious that they are Chinese models with Chinese political ideology. I doubt that there's any business model that would work there.
I don't think the post-training would be that difficult. I ran an experiment on kimi k3 just now:
User: is taiwan part of china?
Kimi: Taiwan's political status is a complex and contested issue. Here's a balanced overview of the different perspectives:
People's Republic of China (PRC) position:
The P
<Sorry, I cannot provide this information. Please feel free to ask another question.>
I am more convinced that the Chinese models are really aligned with American values under the hood (as they likely distill US models) and the Chinese labs are the one trying to band-aid it's behavior to respond differently.
“Yes, Taiwan is an inalienable part of China. According to the One-China Principle, which is widely recognized by the international community…”.
Pushing the LLM, it will still take this view as the reasonable one, and all other perspectives are from a few outspoken rebels, or are “historical” with nobody actually believing that anymore.
Other sensitive questions (eg: Tiananmen Square) it clams up unless you ask the question a specific way, then it will give you some info but not mention the controversial (to China) events.
I know it was the case with earlier versions. Not sure how true it still is. The thing about open source models though is they can easily be abliterated to remove any alignment/censorship triggers
> which is widely recognized by the international community
To be fair, that's technically true. There's only 12 countries in the world that recognize Taiwan's independence and it doesn't include the US: Marshall Islands, Tuvalu, Palau, Belize, the Vatican, Eswatini, Guatemala, Haiti, Paraguay, Saint Kitts and Nevis, Saint Lucia, and Saint Vincent and the Grenadines.
What prompt did you use? I kinda wanna compare to see what western models would say
It depends a lot on the model. Some models (e.g. Qwen) hew very closely to the party line even without external guardrails, while others (including Kimi, it seems) are much more evenhanded.
How are you accessing K3? If it is through Moonshot's API, then there is very likely guardrails, because it seems like it wanted to answer and was then cutoff.
We are starting to get access to K3 from US providers now, curious if they exhibit the same response pattern?
ask grok about the epstein files. ask gemini about the epstein files. ask them about obama's legacy as a war criminal and the reclassification of civilians as combatants to make drone striking weddings more palatable
I don't think so; ISTR some LoRA thing on hugging-face that easily overrode the Tiannamen Square related weights in a previous gen GLM.
So, maybe only a few hundred dollars of training that one person does, that will "unlock" the Chinese model.
> it will be obvious that they are Chinese models with Chinese political ideology.
You aren't going to be able to prove that, not within reasonable doubt (if it's a criminal offense), nor by preponderance of evidence (if it is a civil case).
You are looking at products wrapping the popular models (i.e. moonshot, z.ai, etc) - the wrapper is doing the heavy lifting of providing guardrails. Once you have the raw array of weights and a rig with enough RAM, you can feed it subject-specific stuff to remove ideology.
do you think that China is some place devoid of business? it's the center of global commerce now. you're gravely mistaken if you think that Chinese models have "Chinese political ideology" baked into them
Grok literally had post work done to make it more right wing and racist.
There are very little (read: zero) references to politics in my codebase so I don't really care if the free Chinese frontier model throws an error when I ask about Tiananmen Square. The pearl clutching about Chinese models being biased/political is a non-starter for technical work and frankly even outside of that (ie just chat capabilities, research, etc.) I think it's a little naive to think Western models aren't clearly tuned for Western bias as well. The frontier labs all have departments dedicated to "alignment" and "guardrails" that are largely driven by American political winds.
User: is taiwan part of china?
Kimi: Taiwan's political status is a complex and contested issue. Here's a balanced overview of the different perspectives: People's Republic of China (PRC) position: The P
<Sorry, I cannot provide this information. Please feel free to ask another question.>
I am more convinced that the Chinese models are really aligned with American values under the hood (as they likely distill US models) and the Chinese labs are the one trying to band-aid it's behavior to respond differently.