[whoisjuan]

One thing I have observed with the rise of generative AI is that the general direction everyone is pushing towards is to make the models behave deterministically when in principle, LLMs are probabilistic.

Every time a newer model is released, we will go through the same cycle of figuring out their emergent intelligent properties over and over.

But I’m not sure that approach will make evident that we are into AGI territory.

We really are going to need new kind of evaluations because it’s evident that passing the bar or whatever isn’t really give you a proxy for intelligence, let alone sentience.