[themafia]

> but do not have even a theory about how the behavior emerges

We fully do. There is a significant quality difference between English language output and other languages which lends a huge hint as to what is actually happening behind the scenes.

> but how exactly does anthill behavior come from ant behavior?

You can't smell what ants can. If you did I'm sure it would be evident.

[spiralcoaster]

Two very big revelations here that I would love to know more about:

1. Can you reveal "what's actually happening behind the scenes" beyond the hint you gave? I can't figure it out.

2. Can you explain how an ants sense of smell leads to anthills?

[jen729w]

> 2. Can you explain how an ants sense of smell leads to anthills?

Ant 0: doesn’t seem to be dangerous here. I’ll drop a scent.

Ant 1: oh cool, a safe place. And I didn’t die either. I’ll reinforce that.

Ant 142,857,098,277: cool anthill.

[fc417fc802]

The dynamics of ant nest creation are way more complicated than that. The evolved biological parallel of a procedural generation algorithm. In addition, the completed structure has to be compatible with the various programmed behaviors of the workers.

[kristiandupont]

I am very curious about this significant hint, could you point me to some material?

[canjobear]

> There is a significant quality difference between English language output and other languages

?

[floren]

They're saying LLMs do better when outputting English than other languages, an assertion I'm not really able to test but have heard elsewhere.

[bryanrasmussen]

and this is somehow not related to the size and availability of corpora in English?

[floren]

No, I'm quite sure that's why it's better.

[bryanrasmussen]

OK but then that goes back to their other assertion that it gives a huge hint at what is going on behind the scenes, is that huge hint just "more data gives better results!" if so, that doesn't seem at all important since that is the absolutely central idea of an LLM. That is not behind the scenes at all, that is the introduction to the play as written by the author.

Not your fault obviously, but they have not yet described what that huge hint is, and I'm just at the edge of my seat with anticipation here.