[embedding-shape]

> You can't rebuild it from scratch

> It's entirely reproducible from the available documentation

You have a very interesting understanding of "reproducibility", I'll give you that :)

But even with that, there are plenty of technical details (especially in regards to the training process) missing from the tech report that leads to these weights not being reproducible in any sense of that word.

[nvme0n1p1]

> You have a very interesting understanding of "reproducibility", I'll give you that :)

He was talking about two different things, hence the parentheses. The architecture is reproducible, not the model weights.

[embedding-shape]

> The architecture is reproducible

But what's the point of even saying that? Of course it is, otherwise how is it supposed to run in the runtimes? You cannot release model weights that others can run, without also releasing the model architecture, it's in the code at the very least...

[nvme0n1p1]

Because for other specs it's not the case.

The K3 arch can be implemented from the spec.

A PDF reader can not be implemented from the spec.