Hacker News new | ask | show | jobs
by Karrot_Kream 1173 days ago
The Transformer architecture that powers GPT models is based on a now-famous Google Brain paper, Attention is All You Need. You're right that OpenAI has productized this research much faster than Big Tech, but the research itself came from established R&D in Academia and Big Tech.
3 comments

Well, Google had to figure out how to cancel itself somehow. That's the only Google project, aside from search, that has had staying power.
And Stable Diffusion is based on Google's Imagen paper.
The diffusion papers most analogous to the transformer paper are from Berkeley, Stanford, and Freiburg. Imagen wasn’t foundational in the way you’re suggesting.
Yes, but only one of the authors is still at google.
So if you work on a kickass product at FlorpCorp and then leave, FlorpCorp didn’t develop that product?
Not if FlorpCorp didn't release it.
Yes, the people are where the value is, not a dumb fuck like Sundar.