That would be interesting. If they knew about it shouldn't they published something? Everyone would see the importance being the first with a paper about an AI that can do things it wasn't trained to do?
Was it just corporate secrets or they don't want bad press? The Lemoine incident at Google and how Bing Chat turned into an obsessive lover made me think even those who worked with these AIs didn't really consider the full capabilities of their systems.
I suppose it depends on what you mean by "an AI that can do things it wasn't trained to do"!
In some sense, the AI is still 'just doing what it was trained to do' in that it is 'just' predicting the next word. All examples of AI doing impressive behavior boil down to AI doing what it was trained to do (pick the next word [delta some RLHF tuning]), very well.
If you mean complex behavior arising out of what seems like a very simple unsupervised learning task, then this behavior has been known (although not to this scale) for a while.
For example, I distinctly remember being in my 2018 grad class on deep NLP and having a guest lecturer (Alec Radford) from OpenAI and they were demonstrating how their model got SOTA on summarization tasks just by taking the original text and appending the word "tl;dr" and using what the model produced after that token as the summary. It wasn't trained on a supervised summarization task, it just learned it incidentally from its unsupervised task.
The stuff we are observing is in the same vein as this, just even more impressive. But it is not unknown/completely unexpected behavior prior to ChatGPT.
Certainly it was already well known prior to this paper [0], which puts a lower limit on the timeline as at least 3 years ago.
> Was it just corporate secrets or they don't want bad press?
No, I think it was known & published about, although not as impressive as the most recent iterations. The press didn't realize this was a topic that interested people until 2022 (and really 2023).
Was it just corporate secrets or they don't want bad press? The Lemoine incident at Google and how Bing Chat turned into an obsessive lover made me think even those who worked with these AIs didn't really consider the full capabilities of their systems.