Hacker News new | ask | show | jobs
by veqq 1227 days ago
But you can't run the code on your own machine.
2 comments

> But you can't run the code on your own machine.

iirc GPT-3 itself alone is some 500TB in size. You need a really, really big machine to run LLMs, the first L means Large.

Of course, if they leaked the model weight’s and a local inference binary for it they would lose the ability to charge for it. Clones with the weights would crop up all over the place.