[felippee]

I certainly encourage everybody to consult the source material! Man, this is a blog, opinion by default not perfect.

But when I hear the keyword "major advances" I'm highly suspicious. I had seen already so many such "major advances" that never went beyond a circle of self citing clique.

[evrydayhustling]

As a very concrete "major advance" consider Google Translate's tiny language models [1] that can beam to your phone, live in a few megabytes, and translate photographed text for you with low power usage. This was done with incredibly expensive centralized training, but checks every meaningful box for "scalable" AI.

[1] https://ai.googleblog.com/2015/07/how-google-translate-squee...