[AnotherGoodName]

I agree, i don't think it is the core problem.

Meta doesn't seem to be able to produce anything close to a frontier model. The selling of compute capacity seems to be acceptance of "compute is wasted on this crappy avocado model, we'd be better off allowing something better to run".

The problem is clearly in the model architecture, the training and the data fed into the model which is causing them to give up on using their compute exclusively for their own models. They can't get it right so may as well sell the compute to someone that can.

[GCA10]

Meta has made some very strange decisions in terms of who it's hired to lead various aspects of AI, including the model-building efforts. Also lots to marvel at re: its ability to coordinate (or not coordinate) various efforts by all these big brains.

Can't help but think that Meta's digital networking expertise is built atop a human-networking clusterf*ck

[appplication]

I was never really sold their acquihire of Alexandr Wang as their head of AI being a coherent strategic decision. I just don’t see how his experience and background actually applies for frontier LLM model building.

I think there would easily be a few other hundred engineers and execs at frontier labs who are more in the loop for cutting edge architecture/secret sauce - with a track record of actually doing it - that could be had for a fraction of the price.

[ijk]

From the outside Meta's attempts to pivot from open source releases to fast follow closed models fell flat when they tried to prematurely monetize it. They could have owned the open weight model world but tried to pivot to closed weight chatbots before an actually viable revenue model appeared.

[SoftTalker]

If their training base is dominated by Facebook and Instagram posts then it makes sense that their model is full of shit.

[ridgeguy]

A modern instance of that old saw "you are what you eat".

[orochimaaru]

Does meta have the research talent to create a SOTA frontier model? Yann LeCun has left Meta and I don’t think either alexandr wang or zuck have enough credibility to attract talent to create one.

[fatline]

it's possible Yann LeCun wasn't the right guy either. He seemed to be more focused at finding the next model architecture rather than iterating on the current LLM architecture to build a competitive frontier model.