|
|
|
|
|
by NitpickLawyer
21 days ago
|
|
There's 0 chance of that. You can maybe say that for things like material science, nuclear stuff, weird physics, and so on (basically anything relating to making big booms, delivering big booms, or ensuring others can't make big booms). But having LLMs as we understand them now in the 80s would be impossible. They simply didn't have the compute necessary. The entire world combined didn't have it. For reference, a single 4090 GPU has more FP8 flops than the top supercomputer in 2007. A 4x 4090 computer (something you can buy today for ~10k) would be better than to top supercomputer in 2010 [1]. There's a reason deep learning only started to really work in the past few decades. We had the "theory" for a while, but no compute to actually put it in practice. And the current models are being trained on 10s to 100s of thousand of enterprise GPUs, that make the 4090 look like a toy. [1] - https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni... |
|
All that aside, it would also likely mean that the secret chip fabs eclipse the volume of the non-secret chip fabs by orders of magnitude... covertly? Or are we imagining chips that are 30yr ahead of their time? Either way it's just absurdities upon absurdities..