[elforce002]

According to Ilya Sutskever: "results from scaling up pre-training have plateaued".

https://www.reuters.com/technology/artificial-intelligence/o...

They're trying other techniques to improve what we already have atm.

[luckydata]

and we plow through plateaus every 6 months, regularly, by inventing something new. I thought we were engineers, not some kind of amish cult.