The engineers at google did not sit in a blank room and come up with these ideas out of nowhere. They read the literature to figure out what the hell to do. If you look at the Attention is All You Need whitepaper, you will find there are 32 references, like most ~10 page manuscripts.
The public of the US, China, Japan, the UK, and Canada at the very least contributed to every precursor to transformers in the history of AI. Public and private universities, government grants to them, government projects, prizes to government contests, direct government investment into and subsidies for companies doing commercial research, tax breaks to operators designed to encourage the growth of the field, and large government contracts to use things the government might not even have good uses for yet all add up to government assisted funding.
This is genius. Whenever a company does some fundamental discovery, you can point at some grant they once got for something vaguely adjacent and say "see! quasi-publicly funded!" and your worldview is saved.
It's not vaguely adjacent, the actual foundations of that research were directly publicly funded and wouldn't be possible without it - the author is not talking about how their PageRank algorithm got funded nor money that Google received.
Do you have a reference here, or are you just going to continue to baldly state it as a fact? I’m looking at “Attention is All You Need” and don’t see any grant numbers or anything like that.
The author is correct. It is incredibly simple to trace how public research spending creates scientific advancements and how private companies add on the last 1-3% to commercialize the research.
If you want to learn, go trace how deep learning was funded. It started off with USPS.
My entire argument is that techno-libertarians can enthusiastically say that all great innovations were done inside companies, and progressives/marxists/etc can enthusiastically say that well actually, many of those developments started with publicly funded research projects and public-private partnerships, and both are completely right at the same time because reality is messy. It doesn't prove nor disprove anything about whether governments or companies are better at innovation, or deserve more of the credit, or the upsides.