[jmull]

Just "abilities present in large models not present in small models".

This also makes clear its relative nature (that is, what "large" and "small" mean), which the use of the word "emergent" obscures.

[LawTalkingGuy]

There's things which small models can't do, and where obviously a large model works better. Not emergence, I agree.

I think they're using emergent for a different category of things - still things that a small model couldn't do, but specifically which a large model can just do without any of the work we thought we'd have to do for that ability.

Or at least, that's how I see emergent being a useful term, both in a behavior and a value context.

[1123581321]

That’s much longer and raises more questions (what is large and small, does this gradually or discretely appear.)