[throwaw12]

> My primary concern is the risk that authoritarian governments...

Authoritarian government doesn't always mean bad - look at Singapore

What's more dangerous is country with bunch of war mongering lobbyists who can also influence elections (oops, sounds like USA)

> My secondary concern is the risk that powerful AI models may be misused to carry out cyberattacks or biological attacks

But you are working with DoW and Palantir, who is doing somewhat similar in other countries

> We should not sell powerful chips or chipmaking equipment to China

Israel used banned weapons against Lebanon and Palestinians, would you support similar ban to Israelis?

> We should crack down on industrial-scale distillation operations

Should we also ban distilling public knowledge? Like using textbooks to train the model? Should rules be simple: train your model only on the data you have produced by hand?

[throwaw12]

(comment got too long, continuation)

> All sufficiently capable models, open and closed, should go through mandatory safety testing

Why? And how do you design those tests?

For example, bombing girls school in Iran - is this allowed use according to you or not?

If not allowed use, then how do you guarantee that you don't have a separate agreement with DoW which makes it allowed use and only your model passes it?

[globular-toast]

This isn't Twitter. You can write long comments here.

[throwaw12]

thanks, its not about capabilities, but to respect the human reader who decides whether they should read the comment because its too long or to skip

[CMay]

Bombing that building was an accident due to it being on what was part of a military target and I'm not sure if it was ever made clear whether the building was technically dual use despite also being used as a school. Either way, bombing a bunch of school girls wasn't intentional and nobody reasonable would assume it was.

There was a time we bombed a bus or van with kids in it, but we admitted it and apologized for the mistake. Nobody wants to be bombing kids, first because they're innocent, but second because there is no military advantage to it since it's bad PR.

Many of these targets were identified before Anthropic or OpenAI even existed.

[throwaw12]

If it wasn't intentional and accident, did anyone apologize for that mistake?

Also the point is, you (Dario) can't claim morality, when he is fine doing business with entities literally bombing and killing human beings in other countries.

You are either fine with it and continue working - which Dario is doing

Or you say, I will not work with you.

For Dario, main thing is money, everything else in his article is bs

[CMay]

Cars can be used to escape, or to attack. Guns and knives can be used to defend or to attack.

AI has multiple uses. Military attacks can also save lives. As they say, the best defense is a good offense.

The moral element of it largely falls on the people who made the mistake. That said, it is also widely known that civilian casualties are a part of war. The advent of precision strikes has greatly reduced civilian casualties.

Meanwhile, Iran has intentionally promoted the direct targeting of civilians and killed 10s of thousands of their own, while funding proxies that killed many civilians elsewhere.

[throwaw12]

So now you are using famous knife argument.

In your argument have you considered: selling a knife knowingly to gang members just before they are going to another area to kill other gang members

Anthropic did same when it agreed to sell it's tool to DoW. There is no mistake, no misunderstanding of intentions.

He was super clear that he doesn't give a dime to any lives outside of USA, inside USA he was concerned about automatic weapon usage and surveillance of US citizens, because he himself could be accidentally killed, he doesn't care about others.

[CMay]

That's not accurate. AI can help the military increase precision which can also save civilians lives in other countries where the military is active. AI is not intentionally targeting schools the way Russia is in Ukraine. People are going on about this one single accidental school strike in Iran, meanwhile Russia has hit thousands of schools in Ukraine. Something like 1 out of every 7 schools has been damaged or destroyed and even though the numbers are tracked separately, they have killed something like ~800 children.

A similar argument was made for why Microsoft shouldn't sell software or services to border patrol or ICE. The counter-argument was that if it helps them be more precise and reduce errors in their managing of all the people then it could actually help not just the organization, but also the people.

Again, whether it's human or AI, mistakes will be made and civilian casualties will likely remain a part of war. AI can ideally keep civilian casualties low.

[siruncledrew]

> concerned about authoritarian governments

> praises Trump's administration and Vance in his letter

sure there, buddy...