|
|
|
|
|
by NBJack
542 days ago
|
|
I can't hold a LLM accountable for bad answers, nor can I (truly) correct them (in current models). Dont forget to take into account how damn expensive a single GPU/TPU actually is to purchase, install, and run for inference. And this is to say nothing of how expensive it is to train a model (estimated to be in the billions currently for the latest of the cited article, which likely doesn't include the folks involves and their salaries). And I haven't even mentioned the impact on the environment from the prolific consumption of power; there's a reason nuclear plants are becoming popular again (which may actually be one of the good things that comes out of this). |
|
And inference isn't all that expensive, because the cost of the graphics card also amortises over countless inferences.
Human labour is really expensive.
See https://help.openai.com/en/articles/7127956-how-much-does-gp... and compare with how much it would cost to pay a human. We can likely assume that the prices OpenAI gives will at least cover their marginal cost.