[gpugreg]

> Some of us might be rich

I sure wish I had a few 100M of disposable income to train a frontier model.

> or in the future it could be useful when training is cheaper.

I do not think that physics will allow hardware getting that much faster. But maybe we will have different, cheaper architectures by then.

[Muromec]

If you would tell people at the start of 20th century how much energy we consume, they may not believe you or think it is wasteful.

[gpugreg]

Looks like global energy consumption has risen by an order of magnitude from 1900 to 2000: https://www.encyclopedie-energie.org/en/world-energy-consump...

Unfortunately, electricity prices did not fall by the same factor, so I fear that training a frontier model will still cause a an unsustainable dent in my monthly budget.