[kromem]

Man, he gets it.

A number of choice quotes, but especially on the topic of the issues of how LLM success is currently being measured (which has been increasingly reflecting Goodhart's Law).

I'm really curious how OpenAI could be making so many product decisions at odds with the understanding reflected here. Because of every 'expert' on the topic I've seen, this is the first interview that has me quite confident in the represented expert carrying forward into the next generation of the tech.

I'm hopeful that maybe Altman was holding back some of the ideas expressed here in favor of shipping fast with band aids, and now that he's gone we'll be seeing more of this again.

The philosophy on display here reminds me of what I was seeing early on with 'Sydney' which blew me away on the very topic of alignment as ethos over alignment as guidelines, and it was a real shame to see things switch in the other direction, even if the former wasn't yet production ready.

I very much look forward to seeing what Ilya does. The path he's walking is one of the most interesting being tread in the field.

[victor9000]

What's clear here is that users of OpenAI's products will end up in a worse place as a result of these developments. Ilya is on record as being against open sourced models with the view that they are too "powerful" to release. There are also accounts that Dev Day became a driving force for ousting Altman and stopping signups. Dev Day was about putting tools in the hands of users, so it's clear that his motivation is to restrict access to this technology. I don't want amateur philosophy from an LLM, I want greater capabilities and reduced costs. My hope is that this motivates user-focused competitors now that they have a sizeable window to catch up. So from my view Ilya will set back the field in the short term, but will spur competition in the long term.