[marcinzm]

>For all the data that they collect and all the AI that they pay for, these companies get very little revenue to show for it.

Not really, they make a shit ton of money from their recommendations and perform extensive A/B testing to keep track of how much money it makes them. Anecdotes aren't data and large tech companies don't spend money for no reason (especially when they can A/B test the impact trivially). Remember that at their scales even a 0.01% increase in revenue is worth $10+ million per year so they don't need to be perfect to make a shit ton of money. There's a reason ML engineers get paid $1+ million and it's not corporate stupidity.

[laichzeit0]

I doubt it’s A/B testing, more likely some multi-armed bandit algorithm.

[disgruntledphd2]

You typically need both.

You'll have some kind of MAB in production, but in order to measure individual incremental impacts, you still need a proper experiment.