[dofm]

The problem is that there is an enormous, nearly unignorable incentive to work around it. So they will.

As the customer base becomes more and more corporate (which it will), they end up with disproportionately more customers whose experiences cannot be used to train the model to make it better for those customers.

Either way, corporate customers cannot leach off the training from consumers handing over their personal data forever; there aren't enough specialists in that training set to improve the models with no loss of corporate trust.

Betrayal of their trust is inevitable.

[WarmWash]

Conspiracies are for the chronically online

[rightbyte]

It is rather vague whether you count Sam Altman et al. as "chronically online".

[dofm]

This is not a conspiracy theory. It's futurology, maybe, but pretty basic stuff at that.

At some point, where does the training advantage for specialist LLMs come from, if not progressively encroaching on customer data for the benefit of equivalent customers?