Hacker News new | ask | show | jobs
by andsoitis 336 days ago
> The models

The models don’t have a model of the world. Hence they cannot reason about the world.

3 comments

I tried vibe coding WebGPU/WGSl, which is thoroughly documented, but has little actual code around, and LLMs are pretty bad at it right now.

They don't need a formal model, they need examples from which they can pilfer.

The theory is that language is an abstraction built on top of the world and therefore encompasses all human experience of the world. The problem will arise however when the world (aka nature) acts in an unexpected way outside human experience
"reason" is doing some heavy-lifting in the context of LLMs.