[blueboo]

It rings a bit false when juxtaposed with their $40b spend on the Metaverse…where was the savvy leveraging of the open source community then?

Meanwhile Meta’s competitors commoditise and glean profits from actually-SOTA LLM offerings.

In any case, their hypothesis is testable: which open source innovations from Llama1/2 informed Llama3?

[sudosays]

> In any case, their hypothesis is testable: which open source innovations from Llama1/2 informed Llama3?

I am not sure, but I agree that it is definitely testable.

If I had to guess/answer, I would argue that the open source contributions to Pytorch have a downstream contribution to the performance, and maybe the preparation and release of the models required an amount of polish and QA that would otherwise not have been there.

[skinner927]

The leverage with the Metaverse was eventually users were supposed to create content which in turn makes the product better and brings more users.