Hacker News new | ask | show | jobs
by nl 5 days ago
The two aren't comparable.

You can't reconstruct the same LLM weights even with the same training data.

You can fine tune an open weights model.

Much of the value in modern LLMs is in the RL envrionments, not the pre-training data. That is a very different piece of software to an LLM, and the LLM weights are useful without it.