[anko]

> The cost of computing decreases over time. No one will pay $100 Billion to train GPT-6. That is absurd. The current top supercomputer in the world (Frontier) cost $600M.

Just wanted to ask the question - do you think frontier has provided more or less value to the world than gpt-4?

[xcv123]

GPT-4 is not a piece of hardware. The comparison makes no sense. GPT-4 was enabled by hardware.

The idea is that you use something like a Frontier to create something like a GPT-4.

My point was about cost of computing. What kind of GPT can you train with a $600M computer?