[SubiculumCode]

Has anyone taken these open weight models from China and stripped the CCP out of them? I do not mean that snarkily, I mean review them thoroughly using techniques for weight introspection (concept activations) in response to things that one might expect would trigger deceptive/malicious behavior if the CCP had actually tried to implant context-specific behaviors (e.g. the accusation of generating vulnerable code if being used in American government applications, which I don't know if it was ever proven).

Just in case there are those who'd reflexively down vote this post, I'd just like to say that in a time of great national geopolitical rivalries, this kind of question is not unreasonable one to ask. Indeed, its applicable question whichever nation you live in.

[dev_l1x_be]

> Has anyone taken these open weight models from China and stripped the CCP out of them?

The CCP is not influencing my Rust code quality that much. Though I did notice all my lifetimes are now 'static because nothing is ever allowed to leave the party's ownership, unsafe blocks require approval from a central committee.

Honestly the scariest part is that shared mutable state is forbidden unless the state is doing the sharing.

Otherwise it is pretty ok.

[tomaytotomato]

Check out TNG on huggingface

They are a consultancy in Germany, but I watched a presentation on them tuning and removing bias from Deepseek models. It was quite interesting.

https://www.tngtech.com/en/about-us/news/release-of-deepseek...

(I upvoted your question as I agree)

Its not just code we need to worry about, its also subliminal messaging and other things.

[justinclift]

Sounds like something that heretic or similar might be useful for?

https://github.com/p-e-w/heretic

[threethirtytwo]

Eh even corporate created LLMs are suspect to corporate biases. Nothing is safe.

[SubiculumCode]

Everything is the same is not a serious argument because they are not the same.

[threethirtytwo]

They are different and yet the same. The biggest difference is there’s generally more hatred for China because many us citizens are jealous. But corporate corruption is not that different in safety.

Other than hatred the difference lies in incentives. Corporations want profit. China just wants to spy.

[SubiculumCode]

That is a.limitee understanding of China's ambitions here.

[threethirtytwo]

I’m Chinese bro. The American or international understanding of Chinese ambitions is a cartoon caricature of reality. You are ignorant.

In the context of LLMs spying is the biggest threat. The other biggest threat is information cover up. They don’t want the model to talk about embarrassing shit like tian men square.