[arowthway]

I don't think there is any "humans are metaphysically superior to LLMs" subtext to this talk, it's just a technical/educational observation.

Access to some forms of evaluation and selective retention is inherent to humans and it's not inherent to LLMS. But it can be somehow bolted on and that's when they work best. It makes sense that more focus on those principles can yield better AI. I think the retention part is the real limitation of LLMs, because it's limited to stuffing things in context window.

[simianwords]

> Access to some forms of evaluation and selective retention is inherent to humans and it's not inherent to LLMS

I'm not sure I understood - what forms of evaluation is inherent to humans? If you don't give humans tools or access to the physical world, how can they evaluate?

[arowthway]

There's no such thing as a human without access to the physical world.

[simianwords]

So technically the only reason AI can't do discovery is access to physical word. When you give AI and humans access, they both do discoveries - that is the clean summary of the author's position.

Its not too interesting.. we already know that giving AI access to compilers and tools make them better.