[criddell]

Yes, it's mostly true. Everything will eventually be released, they are just doing so in stages and are hoping to generate a broad discussion of the technology and it's implications.

Some details are available here:

https://openai.com/blog/better-language-models/

[gwern]

There's two issues here. There's the models and there's the source code. The two smallest models have been released now, but it's unclear if/when OA will release any more publicly. They have released even less source code: all the code people have been using to train & finetune GPT-2 models has been implemented by third parties and OA has declined to release any code beyond simple sampling code, with no hint of even considering releasing training code in the future, much less releasing 'everything'. (And the sampling code isn't even that great; top-k sampling, for example, instead of standard beam search.)

[pigscantfly]

A cynic might counter that this is not going to qualitatively change things and that there is a huge PR motive, but no one's a saint, you know?