Hacker News new | ask | show | jobs
by maaaaattttt 886 days ago
Saying they make it “open source” in the same article where they say they need “350k high end GPUs to build it”. Is the equivalent of saying: ”we offer free nuclear submarine driving lessons”.

I know you don’t need as many resources for inference as for training. But still…

3 comments

What do you mean “but still…”? It’s a pretty important distinction. Meta does indeed use their massive GPU farms to train models and then release the weights for free and people indeed run inference on prosumer hardware
How different is saying they built React using 100-500+ developer years of effort and then open sourced it. What they are releasing is what is needed by most of the people looking for open models.
You can run llama models on a personal computer, even though it was trained on >10,000 GPUs.