|
|
|
|
|
by ctoth
10 days ago
|
|
> This entire thing is extremely historically contingent, and we could easily stop this train tomorrow. So, the Baruch Plan? The Manhattan Project was $~2B in 1945 dollars, and a national-scale industrial mobilization. Now North Korea has the bomb. That's with nuclear material, which doesn't get easier and easier and easier to work with every year. Compare to the price to train GPT-2 in 2019 ($43,000), and in 2026 ($73) [0]. [0]: https://x.com/karpathy/status/2017703360393318587 |
|
The point being: the price to train frontier models isn't coming down, nor is it going to come down because for models to remain on the frontier they have to keep getting bigger and bigger (and trained on more and more data).