[sirsinsalot]

Not to be pedantic but the emergent properties are in the training set, and thus the model and algorithm. There's no magic coming from the universe.

What makes the behavior emergent is that it can't be predicted at training time.

The emergent and unpredictable output is the result of massive vector complexity being encoded.

[coldtea]

>Not to be pedantic but the emergent properties are in the training set, and thus the model and algorithm. There's no magic coming from the universe.

You are either being pedantic or missing the point of emergent however.

Yes, it's not some novel unforeseen thing, like a magical Marvel Universe material or some unknown to humanity mode of thinking. Same way when people make something new they still recombine known words, or colors, or physical things in the universe.

It is however new capabilities that is not explicitly in the training set and can't be predicted by it. Like teaching something only calculus training materials and it figures out boolean algebra.

>The emergent and unpredictable output is the result of massive vector complexity being encoded

As opposed to what in humans? God given revelation?

[sirsinsalot]

My point was that if training data + encoding/training = model with emergent behaviour

The emergent behaviour is in the training data and/or encoding/training.

So while I agree it is emergent from the complexity, it isn't some unknown mechanism. Just complexity at scale.

[coldtea]

>So while I agree it is emergent from the complexity, it isn't some unknown mechanism. Just complexity at scale.

So like humans? Like the universe?