[anxrn]

Yes, this paper [1] introduced the term.

https://scholar.google.com/citations?view_op=view_citation&h...

[runnerup]

Weird. The term “Generative pretraining” seems to also exist in this 2016 proceeding from 2 years prior: https://ui.adsabs.harvard.edu/abs/2016arXiv160202644D/abstra...

Google Trends shows it first got searched for in measurable quantity back in 2008.

[reaperman]

Here's "generative pretaining" in an IEEE publication from 2012. https://www.cs.toronto.edu/~hinton/absps/DNN-2012-proof.pdf

Geoffrey Hinton wrote it. I wonder if he'll have anything to say about OpenAI trademarking the term 11 years after he wrote this. Here's an earlier publication from January, 2012 talking about Hinton's 2011 "Generative pretraining" work: https://www.microsoft.com/en-us/research/publication/three-c...

[hn_throwaway_99]

> Geoffrey Hinton wrote it. I wonder if he'll have anything to say about OpenAI trademarking the term 11 years after he wrote this.

But they're not applying to trademark "generative pretraining". They're only applying to trademark GPT, which seems (I have very limited knowledge if there are other competing uses of the term) reasonable given that most people associate "GPT" with specific AI implementations created by OpenAI.

There were other "business machine" companies that existed 100 years ago, but that is very different from trademarking "IBM".