[qsera]

> what happens when it doesn't?

It will never happen. Capitalism works when consumers can choose the best service provider. When there is only one universal service provide (AI), behind various "fronts", it would be catastrophic.

And all the consumers lose catastrophically.

So there should be at least some human component to differentiate between the various "AI" providers.

[_DeadFred_]

But if the AIs learn from the business (at some point they need to) then the differentiator get's absorbed back. If you figure out how to optimize your AI/humanoid robot, that benefit you have only lasts until the next AI model that incorporates your successes.

[qsera]

But LLMs does not learn/train like that. They need the same thing repeated a gazillion times in the their training data to actually use it in inference.

So unless this human element get absorbed widely into literature, then I think the scenario you present is not possible, at least in the context of current LLMs.

May be there will be true AI in future, that can read a fact and grasp it brilliance, like a human do, and use it in answering future questions. Then what you said could be possible.

[_DeadFred_]

I'm assuming for it to work at the level of filling rolls in businesses like this they will need to generate synthetic data to train on from onsite data, which will be the best practices of you and your competitors and hence include the corpus of what makes you better/lean compared to your competitor and remove differentiators.

[gbear605]

That’s a should, what makes it a will? Capitalism can just be killed by AI.