[IntrepidPig]

I always felt like one of reasons LLMs are so good is that they piggyback on the many years that have gone into developing language as an information representation/compression format. I don’t know if there’s anything similar a world model can take advantage of.

That being said there have been models which are pretty effective at other things that don’t use language, so maybe it’s a non issue.

[ares623]

I will gladly take $10B to find out for you.

[gugagore]

Another way to make the same point is to observe that every single society has language.

But only some groups have the ability to systematically encode language as writing.

Writing is a technological marvel.

[tim333]

There's a lot of info about the world in video and photographs. A lot of how we learn is seeing things. Plus interacting of course.