Hacker News new | ask | show | jobs
by quatonion 20 hours ago
Half of me wonders if it was all a live simulation/drill, to practice what happens if a much more serious event occurs, and a model needed to be quickly shut down.

Under such conditions we would be looking at Amazon's actions through a much more benevolent lens.

Not saying it has been, but it certainly crossed my mind as something worth doing regardless.

2 comments

> "to practice what happens if a much more serious event occurs"

A pair of bolt cutters should do.

That's certainly one way to do it, but where would you place them?

No, but seriously, you could imagine what we witnessed playing out in a high stakes Tom Clancy or Michael Crichton style fable.

The fiery blowhard Pentagon chief, the arrogant know it all tech bro lab head, an alarm being called in from a remote office and surfaced through Amazon.

It almost writes itself.

But we can use your name for the novel.

"Bolt Cutter"

Has a nice ring to it.

Even if it's not intended to be a drill, this dynamic is why I can't take Anthropic's side here. If you believe what they claim to believe about the future of AI, which I at least do, there are going to be future cases where an emergency block is required for much more real threats than this one. Why in the world would Amodei think that the model provider, with massive financial incentives to keep the money flowing, should be allowed to make the final shutdown call?

If a team of researchers at Netflix discovers a few days after release that GPT 6.0 has a safety-compromising jailbreak, I want Sam Altman initiating a shutdown the second he gets that call, and I had thought until Friday that Anthropic agreed with me.