[stubish]

I doubt the safety argument will hold up in court. Anything safe enough to allow Microsoft or others access too would be safe enough to release publicly. Our AI overlords are not going to respect an NDA. And for the public safety/disinformation side of things, I think it is safe to say that cat is out of the bag and chasing the horse that has bolted.

[bandyaboot]

If the above statement is the only “commitment” they’ve made to open-source, then that argument won’t need to be made in court. They just need to reference the vague language that basically leaves the door open to do anything they want.

[WhatIsAModel]

https://arxiv.org/abs/2311.03348

This seems to make a decent argument that these models are potentially not safe. I prefer criminals don't have access to a PhD bomb making assistants who can explain the process to them like they are 12. While the cat may be out of the bag, you don't just hand out guns to everyone (for free) because a few people misused them.

[tintor]

`Anything safe enough to allow Microsoft or others access too would be safe enough to release publicly.`

This makes absolutely no sense.

[rl3]

>This makes absolutely no sense.

https://news.ycombinator.com/item?id=34716375

What about now?

[cutemonster]

Microsoft doesn't run troll farms trying to manipulate the voters to change the US to a dictatorship, or develop killer drone swarms or have nukes.

(Not saying OpenAI isn't greedy)

[rl3]

I think you make a good point. My argument was that Microsoft's security isn't that great, therefore the risk of the model ending up in the hands of the bad actors you mention isn't sufficiently low.

[cutemonster]

Aha, ok thanks for explaining

[salawat]

...What OS do you think many of these places use? Linux is still niche af. In a real, tangible way, it may very well be the case that yes, Microsoft does, in fact, run them.

[Dylan16807]

The "..." is not warranted because that is clearly not the sense of "run" they were talking about.

[sanxiyn]

I am unsure. You can't (for example) fine tune over API. Is anything safe for Microsoft to fine tune really safe for Russia, CCP, etc. to fine tune? Open weight (which I think is more accurate term than open source here) models enable both much more actors and much more actions than the current status.

[pclmulqdq]

You can fine tune over the API. Also, Russia and the CCP likely have the model weights. They probably have spies in OpenAI or Microsoft with access to the weights.

[WanderPanda]

Interesting thought experiment! How would they best take advantage of the weights and what would be signs/actions that we could observe that signal it is likely they have the weights?

[simfree]

We know Microsoft experienced a full breach of Office 365/Microsoft 365 and Azure infrastructure by a nation state actor: https://www.imprivata.com/blog/strengthening-security-5-less...

[petre]

They'll train it on Xi Jingping Thought so that the people of China can move on with their lives and use the Xi bot instead of wasting precious man hours actually studying the texts.

The Russians will obviously use it to spread Kremlin's narratives on the Internet in all languages, including Klingon and Elvish.

[HeavyStorm]

I don't think such speculation would _hold in court_

[pclmulqdq]

A quick Google search has confirmed that Microsoft has confirmed at least the Russia part:

https://www.cyberark.com/resources/blog/apt29s-attack-on-mic...

It's very hard to argue that when you give 100,000 people access to materials that are inherently worth billions, none of them are stealing those materials. Google has enough leakers to conservative media of all places that you should suspect that at least one Googler is exfiltrating data to China, Russia, or India.