Hacker News new | ask | show | jobs
by blhack 110 days ago
Did the DoW ask for these things?

This whole thing seems like people talking past each other, and that there’s something being left unsaid.

Anthropic doesn’t make a product that would assist with kill drones, and they don’t have the right to deny subpoenas.

5 comments

There are enough idiots involved who "heard about this AI thing" that would demand someone make a Claude-based kill bot. Do not underestimate the disconnect from reality of senior military leadership. They easily forget that everyone who works for them are legally obligated to laugh at their jokes.
Anthropic specifically called out systems "that take humans out of the loop entirely and automate selecting and engaging targets".

I take that to mean they don't want the military using Claude to decide who to kill. As a hyperbolic yet frankly realistic example, they don't want Claude to make a mistake and direct the military to kill innocent children accidentally identified as narco-terrorists.

At least, that's the most charitable interpretation of everything going on. I suspect they are also worried that the sitting administration wants to use AI to help them execute a full autocratic takeover of the United States, so they're attempting to kill one of the world's most innovative companies to set an example and pressure other AI labs into letting their technology be used for such purposes.

Right. Did the DoW ask for that? Or does Anthropic make a product that does that?
Obviously Anthropic does make a product that could do that -- just give Claude classified data and ask it who to target.

Obviously the military wants to use it for that purpose since they couldn't accept Anthropic's extremely limited terms.

One can easily and immediately infer the answers to both your questions are yes.

The DoW has explicitly said they don’t want this, and what you are describing are not automated kill drones.

Anthropic’s safeguards already prevent what you are describing, again the thing thar DoW has said they don’t want.

I don't know what you're referencing, but it doesn't matter. I judge people by their actions more than their words. The actions in this case are simple: Anthropic doesn't want their models to be used for fully autonomous weapons or mass surveillance of American citizens, but everything else is fair game; in response, the sitting administration is attempting to kill the company (since a strict reading of the security risk order would force most of their partners, suppliers, etc., to cut them off completely).

Giving precedence to words over actions is how you get taken advantage, abused, deceived, etc.

GOOD. I don’t want Anthropic, or anybody else to have their tools used for these things either.

But Dario is showing weakness here by talking around it. Whatever they were asked to do, they should just be upfront about.

The DoD is explicitly asking for those things, by forcing contract renegotiation towards a contract that is identical in every way, except removing the prohibition on those things.

If the DoD did not want those things, it would not be forcing a contract renegotiation to include them, at great cost to the government.

No, the DoW may be implicitly asking for those things.

That’s the point I’m trying to make here: Anthropic should just say the unsaid thing here.

DoW asked for the following thing: $foo. We won’t give that to them.

> Anthropic should just say the unsaid thing here.

> DoW asked for the following thing: $foo. We won’t give that to them.

Anthropic has explicitly said that multiple times, including in the letter we are presently discussing.

$foo is the ability to use Claude for domestic mass surveillance and analysis, and/or fully-autonomous killbots.

That thing is removing the restrictions from the contract.
https://x.com/SeanParnellASW/status/2027072228777734474?s=20

Here's the Chief Pentagon Spokesman pointing to the same verbiage and reiterating they they won't agree to those terms of use.

The first sentence of that post is:

> The Department of War has no interest in using AI to conduct mass surveillance of Americans (which is illegal) nor do we want to use AI to develop autonomous weapons that operate without human involvement.

Saying something on twitter is not a guarantee.

Tomorrow he could change his mind to "we want to use AI to develop autonomous weapons that operate without human involvement." the issue is that he wants Anthropic to change the use terms because "We will not let ANY company dictate the terms regarding how we make operational decisions."

>he said this

>>no he didn’t he actually said the opposite of that and the link you just posted says the opposite of what you are claiming

>but he might change his mind!

Okay?

This administration would never lie, no siree! And especially not on Twitter!

I'm torn here. Who should we believe? The normal people or the people who operate exclusively in dishonesty?

And yet, if that statement were true, and not a lie, we would not be here right now, discussing their insistence upon being able to use software for precisely those things.

Is a pundit/politician lying to you a new experience?

I certainly wouldn’t give them the benefit of the doubt.
Then Anthropic should say: this is what the DoW has asked for, and we aren’t able to do it, or don’t want to.
They may not be legally allowed to.
What do subpoenas have to do with anything?

Where is all the weird misinformation in these comments coming from?

Because mass surveillance has been happening by every tech company under every president since George W. Bush, and despite everybody trying to stop it they haven’t been able to.

OpenAI has already said that they’ll give up whatever info the government wants if they’re issued a subpoena; they don’t have a choice.

A subpoena isn't mass surveillance.
Well I certainly feel surveilled when I know that OpenAI will simply give up my data if asked.

If anthro is saying they won’t, that’s good!

Companies have to comply with subpoenas (unless they can beat them in court, and with an alternative of going to jail). Subpoenas are supposed to be targeted at individuals and need some kind of process, usually judicial, each time one is issued. Mass surveillance - the Anthropic blog post raises the possibility of using AI to classify the political loyalties of every citizen - is a different thing.
A subpoena isn't "simply asking." Subpoena literally means "under penalty" in Latin. If the company does not comply they will be held in contempt of court and someone may well go to jail.
You make a valid point. Dario suggests that DoD wants to have the capacity to do domestic surveillance and autonomous killing. Sean Parnell said the DoD doesn't want those capacities. These statements are in conflict. Them talking past each other is one possibility. Without much evidence except the track record of the Trump administration, I think it is much more likely that Sean Parnell is lying.
The announcement hasn't worked through official legal channels, but Anthropic is taking it seriously. The official channel will be a written explanation to Congress, and could be classified.

Hegseth objected to guardrails being "woke". Something about "curly haired" almost-men telling him how he can use his "war fighters".

I speculate that Trump and Hegseth were both late to the realization that AI could unwind, for example, the next Panama Papers, and are doing this to try to demonstrate power to the industry. Musk tried to explain all this, but they actually encountered him as "autistic". This all looks like a disjointed conversation because we can see slightly more of the future than them.