[rafaelmn]

That's the part that makes current LLMs fundamentally flawed as AGI agents - unless you incorporate experience based knowledge validation/learning - the book knowledge you have is useless. Most of published research out there isn't reproducible, and that's the highest standard we have for published knowledge.

[visarga]

I mean, there is plenty of "experience" codified in the raw internet scrape they used. But not enough for LLMs, and not in-domain. So it won't contain the kind of errors LLMs make and corrective feedback.