[CharlesW]

> these people assume every single bit of intelligence these models show is somehow in their training set which is patently false and very easy to test that it is false.

Interesting, please create the very easy test that proves that.

[dkarras]

one was already provided in my comment. ask it to create something by prompting the idea that only exists in your imagination, set up the constraints with natural language, and guide it to explore the dynamics of it with the context and constraints you just provided. you can see before your very eyes that it can interact with a context and set of constraints you just pulled out of thin air, something that exists nowhere but its context window.

I mean even being able to find the salient points and summarize an article that was written today (not in the training set) is intelligence, but some would move goal posts thinking it is something so simple, and from your tone I assumed you'd claim it as such. so I provided a hopefully more foolproof version of testing emergent intelligence that extends beyond training data.