|
|
|
|
|
|
by Breza
72 days ago
|
|
|
I'm not excusing Altman's many many lies, but it is worth noting how many algorithmic advances in the past 20 years were made with relatively little computing power. Think of things like xgboost (2016). A modest computer can run a pretty big dataset on CPU. When Tensorflow was launched in 2015, I played with it on an ancient laptop and it worked just fine. Then I upgraded to a mobile workstation and was still able to keep up with many SOTA models. Turns out LLMs are massively more power hungry than most earlier algorithms, even in NLP. |
|
|