[hendzen]

@pg on @sama: "you could parachute him into an island full of cannibals and come back in 5 years and he'd be the king."

In retrospect this quote comes across as way more foreboding given what we've learned about the scale of his ambitions and his willingness to lie and bend reality to gain power.

Dario on the other hand seems to have an integrity that's particularly rare in this era. I hope he remains strong in the face of the regime.

[neya]

>Dario on the other hand seems to have an integrity that's particularly rare in this era.

Anthropic actually partnered up with Palantir. They are not the saints you think they are, either.

We should stop worshipping people and companies and stop putting them on pedestals. Just because one party is at fault, doesn't mean the other is automatically innocent. These are all for-profit companies at play here.

https://investors.palantir.com/news-details/2024/Anthropic-a...

[devinplatt]

FWIW he gives his ethical reasoning on his website:

> Broadly, I am supportive of arming democracies with the tools needed to defeat autocracies in the age of AI—I simply don’t think there is any other way. But we cannot ignore the potential for abuse of these technologies by democratic governments themselves. Democracies normally have safeguards that prevent their military and intelligence apparatus from being turned inwards against their own population, but because AI tools require so few people to operate, there is potential for them to circumvent these safeguards and the norms that support them. It is also worth noting that some of these safeguards are already gradually eroding in some democracies. Thus, we should arm democracies with AI, but we should do so carefully and within limits: they are the immune system we need to fight autocracies, but like the immune system, there is some risk of them turning on us and becoming a threat themselves.

Basically, he's afraid that not arming the government with AI puts it at a disadvantage vs. other governments he trusts less. Plus, if Anthropic is in the loop that gives them the chance to steer the direction of things a bit (what they were kicked out for doing).

It's not the purest ethical argument, but I also would not say that there is a clearly correct answer.

[neya]

Basically he's asking everyone to trust him that he won't cross the line himself. Whatever argument he makes for democracies applies to him as well, and he's not somehow above it. That's the flaw in his argument.

Brutally honest, to me it just sounds like a very elaborate way to say "trust me, bro"

[vanillameow]

I would agree if not for the fact that they just let a $200M contract slip through over it. You could argue it's "safety theater" in itself but that seems like a risky gambit especially with this administration. I definitely trust Anthropic more than OpenAI. In fact I'd go as far as to say it's probably pretty imperative that Anthropic stays a frontrunner in this race and doesn't leave the field exclusively to OAI (and maybe Google which is just as bad). That doesn't mean I'm exactly happy with Anthropic's comments like "mass surveillance bad but only for the US". But Anthropic at least regularly asks questions about the direction of AI development. I haven't seen the other frontier model companies do any such thing.

[taurath]

What does $200m mean for someone who thinks a trillion in revenue is likely among AI companies in the next 5 years? Which is a real quote.

[vanillameow]

Regardless, I think if you are thinking purely from a ruthless business standpoint then standing up to the DoD was an incredibly ill-advised move. It's basically free financial and technological backing at the cost of ethics. Additionally, basically everyone with functioning eyeballs knows that the current US administration is incredibly vindicative, reckless and short-tempered. I would agree that in a more tame administration, you might do something like this as a publicity stunt. In the Trump administration, and while the AI arms race is still in full force, it feels like there has to be at least somewhat genuine sentiment behind it, otherwise it just doesn't really make sense. Like what do they accomplish from this? You'll get some users who will view you more favourably for it but it probably won't make up for the lost revenue, and no matter how many people like you, if you are first to AGI in this industry you win. The prior sentiment basically won't matter at that point. In the most critical interpretation I guess you could say if the bubble pops it might be more of a matter of sentiment. I don't know, in my mind the math just doesn't work for it to be a business move.

[freejazz]

A lot of words to say nonsense

[fmajid]

If you look at his comments about Palantir and their proposed safeguards, it's clear it's a case of "if you are dining with the Devil, you'd better bring a very long spoon"

[neya]

These comments were after the deal had soured. Not before. If it was a case of such morality, the partnership with Palantir would have never happened in the first place.

The contract was explicit - it was for defence purposes with a company known for spying activities. So, obviously spying is involved and they weren't just going to generate cat videos with it.

Again, nobody is innocent here.

[xvector]

If you actually read the memo they've clearly put in strict terms with Palantir and rejected many of the false "safeguards" offered by the company

[dota_fanatic]

I've heard Palantir is essentially the only federal cloud vendor with this administration for secure services. By "partnered up with Palantir", do you mean they provided their models to the government? Or something more?

[neya]

From the title of the link enclosed:

"Anthropic and Palantir Partner to Bring Claude AI Models to AWS for U.S. Government Intelligence and Defense Operations"

Keywords: "Government Intelligence"

[pton_xd]

> Anthropic actually partnered up with Palantir. They are not the saints you think they are, either.

And now you've got people on here saying, well actually Palantir ain't so bad, you see! They're just one tool in the chain, basically just boring data integration, like IBM!

The mental gymnastics is difficult to keep up with.

[neya]

Haha, absolutely agreed. Morality is a moving goal post when it comes to everyone's personal favorites.

[phendrenad2]

pg's sama praise bewilders me. Is there some other Sam Altman he's talking about?

> Graham was immediately impressed by Altman, later recalling that meeting the 19-year-old felt like what it must have been like to talk to Bill Gates at the same age. He noted Altman's intense "force of will" from their early interactions.

Is there a Gates-like "presence" or a "force of will" displayed in his public interviews?

[sethops1]

The only vibe I get from Altman is that he's a weasel, willing to say anything or burn whatever to get what he wants.

[username223]

> pg's sama praise bewilders me. Is there some other Sam Altman he's talking about?

Paul Graham was a pudgy mediocrity clever enough to capitalize on nerds' obsession with Lisp, and leverage it into f-you money. Game recognized game in the shape of Sam Altman.

[DaedalusII]

yeah man what a mediocre loser all he did was create the first cloud based ecommerce platform , sell it to yahoo for $49m in the 90s, then co-found the most successful early stage VC firm of all time, which made THIS forum which you are using to attack him

lol

[neya]

Given Gates' current reputation, I don't think this aged well.

[gadders]

Especially if you ask Altman's sister (allegedly)

[DaedalusII]

its reasonable praise. a 19 year old social outcast who grew up in the midwest drops out of ivy league and starts a company before smartphones exist that he sells for $43 million dollars at age 27, then invested almost all the money into more startups, became a billionaire, and hijacked chatgpt from the richest person in the world.

its not a comment on his ethics or morality

[asveikau]

I think I'm a bit more of an iconoclast than the average HN reader, but when this community was fawning over him when he was head of YC, I always got the impression, without knowing the guy or much about him, that it was totally undeserved. Mainly because thoughtless fawning of any kind makes me immediately suspicious. Nobody deserves that kind of praise.

I read that quote and see no positive interpretation. It was always a negative description.

I think maybe this community could use a bit more natural skepticism of hierarchy.

[IncreasePosts]

Same. What sam tried to do on his own, he failed at (not horribly failed, but he certainly wasn't in the same league as zuckerberg or page or gates or musk - he raised at least $30M then was forced to sell a failure of a product for $40M).

His ascendancy only came when he basically was given an ulta powerful position by an ultra powerful man.

[arduanika]

> be the king

Which of these two CEOs wants to have an unelected spot in the decision loop of our government?

Once I dug into this story, I realized that only one of these companies was attempting a real power grab. Maybe the EAs are doomed to try coup after coup and lose every time.

The SCR part is excessive, though, especially if it's interpreted broadly. Altman gets credit for sticking up for Anthropic on that point, but not much credit, because it's so obvious that it's overkill.

[nradov]

It's always hilarious watching online fights between tech industry billionaires, sort of like the geek version of UFC. The weirdest part is how regular people pick sides and defend their billionaire against the other guy.

[derwiki]

Why is that weird? If we do that for UFC and other sports

[neya]

> The weirdest part is how regular people pick sides and defend their billionaire

Someone told me in another comment that it's possibly bot activity. I suspect so too, because in a tech forum like HN, a top voted comment can shift the entire focus/narrative of any given issue. I know there are a lot of mods on here to prevent this sort of thing, but given how good LLMs have gotten, I wonder if we are at a point where humans can even discern cases where this a mix of human and AI involvement in online activity (such as commenting).

[sixothree]

It's not only single comments, but if you surround people in a sea of opinion, they will definitely start swimming in your direction. Thought, that's probably more important on reddit.

[gottorf]

> that's probably more important on reddit.

I don't know if you've noticed, but HN has been full of Reddit-tier comments, most especially around hot-button political topics, for a while now.

[neya]

It's been this way for the last 6-7 years IIRC

[mrguyorama]

Naw HN has been like this for a decade at minimum. None of the temporarily embarrassed billionaires here needed a bot to simp for rich people.

The entire point of the forum is to talk about rich "idea people" and the businesses they start to get richer.

[retsibsi]

It's very easy to adopt a posture of above-it-all cynicism, and to think that anyone who sees an important distinction between two flawed powerful people is a sucker. But it's not particularly smart or sophisticated, and it's not helpful. In politics, the assumption that they're all equally corrupt and sociopathic is exactly what the worst of them want us to default to. In rich-guy PR wars, too, it's only going to work to the benefit of the ones with 0 principles, at the expense of the ones with some principles.

(Or, if the maximally cynical perspective is correct and 'principles' always actually means 'a company culture and public image that depends on the appearance of having principles, and which requires costly signals of principledness to maintain' -- well, why on earth shouldn't we favour the ones who have that property over the ones who are nakedly unprincipled, and the ones who have a paper-thin veneer that doesn't meaningfully affect their behaviour? It would be stupid to throw away the one bit of leverage we have to make powerful people behave better than they otherwise would.)

[beepbooptheory]

In retrospect?

[ProofHouse]

Don't be fooled. Dario's 'awe shucks, me' routine and 'but, but, but' is not all that is looks to be on surface.

[skeptic_ai]

So mass surveillance on non us citizens is having integrity?