[hackinthebochs]

Has Chollet ever talked about his change of heart regarding AGI? It wasn't that long ago when he was one of the loudest voices decrying even the concept of AGI, let alone us being on the path to creating it. Now he's an advocate and has his own prize dataset? Seems rather convenient to change your tune once hundreds of billions are being thrown at AGI (not that I would blame him).

[zamderax]

People are allowed to evolve opinions. It seems to me he believes that a combination of transformer and program synthesis are key. The big unknown at the moment is how to do program search.

[hackinthebochs]

Absolutely. Presumably there is some specific considerations or evidence that helped him evolve his opinion. I would be interested in seeing a writeup about it. With him having been a very public advocate against AGI, a writeup of his evolution seems appropriate and would be very edifying for a lot of people.

[Bjorkbat]

I recall it as less an evolution and more a complete tonal shift the moment o3 was evaluated on ARC-AGI. I remember on Twitter Sam made some dumb post suggesting they had beaten the benchmark internally and Francois calling him out on his vagueposting. Soon as they publicly released the scores, it was like he was all-in on reasoning.

Which I have to admit I was kind of disappointed by.

[brcmthrowaway]

What exactly is "reasoning"?

[shwaj]

In this context I believe it refers to models that are trained to generate an internal dialogue that is then fed back in as additional input. This cycle might be performed several times before generating the final output text.

This is in contrast to the way that GPT-2/3/“original 4” work, which is by repeatedly generating the next finalized token based on the full dialogue thus far.

[brcmthrowaway]

Who invented internal dialogue?

[blibble]

> Presumably there is some specific considerations or evidence that helped him evolve his opinion.

suitcases full of money?

[cubefox]

ARC-AGI was introduced in 2019:

https://arxiv.org/abs/1911.01547

GPT-3 didn't come out until 2020.

[hackinthebochs]

In my view that just makes his evolution more interesting as it wasn't just a matter of being wow'ed by what ChatGPT could do.

[0xCE0]

He has recently co-founded NDEA company, so he has to align himself for that. Same kind of vibe change feels for Joscha Bach after having some position in Liquid AI company. Communication is not so relaxed anymore.

That said, I'd still listen these two guys (+ Schmidhuber) more than any other AI-guy.