Hacker News new | ask | show | jobs
by robbomacrae 941 days ago
How would such a merger be good for AI safety? A combined OpenAI-Anthropic would collectively own 6 out of the top 6 LLM's on the chatbot arena leaderboard [0] which would seem to be somewhat monopolistic. This would result in less choice for us developers.

Isn't it better to have the top two AI firms both upholding AI safety as a core principle?

To me this weakens the original argument they had for sacking Sam in the first place.

[0] https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...

3 comments

You have a point, but one could easily frame it differently.

- the openai board is the non-profit, meant to make "good" decisions, and not necessarily business sense decisions.

- altman was fired because that board doesn't feel it can rely on him (both in action and in communication), he'll do what he wants and he won't be obvious about the fact he's not listening to them.

- now altman and co. are essentially going to kill openai as a company, leaving it only with the existing IP, so the board figures that they should bring in people who are interested in working / researching on top of openai's previous work.

- anthropic is composed of people who left openai due to safety concerns, so they're good people to partner with.

The fact that it would be better safety-wise if there was competition (maybe?) is immaterial when facing the fact that 1) openai appears to be collapsing, and 2) microsoft anyway has rights to openai's work, and Microsoft appears to be preparing to cannibalize openai.

It has never been about AI safety. They just threw their little mission statement on the end like an email signature.

Nothing could possibly weaken their position more than the last 72 hours

In which sense less choice for developers harms AI safety?

(I'm saying this as someone that doesn't believe in AI safety as a worthwhile goal)