[fasterik]

Taking a single paragraph of literary text, which is abstract and ambiguous, and converting it into a 3D animation requires an enormous amount of implicit knowledge about spatial relationships, intuitive physics, everyday objects, and so forth. Not to mention the mathematics of 3D transformations and computer graphics more generally. Saying that it's indicative of no more than three.js coding ability is absurd.

[beepbooptheory]

Why does it require knowledge about spatial relationships?

[fasterik]

Because the degree of realism in a video is determined by implicit knowledge of concepts like "in front of", "behind", "next to", "inside", "outside", "between", "occluded by", etc. as well as distances, angles, and the relative size of objects when viewed from a perspective.

[beepbooptheory]

I guess I just don't have an intuition for why that is different from what it does for non-"spatial" things. Like the fact that it works is still because it produced the code it did token by token. Whether its dealing with, e.g., "beside the rock" or "in the array", it's doing the same kind of inferential activity.

[fasterik]

>Whether its dealing with, e.g., "beside the rock" or "in the array", it's doing the same kind of inferential activity.

Are you sure about that? Presumably the spatial concept of "inside" and the computer memory concept of "inside" have different contextual embeddings in an LLM, much in the same way that neural activation patterns vary in the human brain when we reason about different domains.

[emp17344]

You are correct. It’s important not to let hype peddlers imply AI possesses consciousness.