[aurareturn]

  And then everyone would stop using their inference as soon as a better model for a reasonable price came out.

Exactly. It's competition now that is driving high training costs - not a business model problem. There will be winners and losers. The losers won't be able to keep up with the training costs forever. See my post here: https://news.ycombinator.com/item?id=49119265

[oersted]

It's never that simple, that's not the only possible endgame.

We have seen plenty of examples in other industries where you can never really stop investing a ton on R&D with diminishing returns (like in semiconductors or pharma), because the moment you stop newcomers overtake you.

Or the whole thing becomes a commodity with lots of competitors, where technological advantage is overtaken by marketing as the dominant force.

Or you really are left as the only player alive, but you realise that the market cannot absorb higher prices for your product by then, they prefer just not to buy it. Perhaps you are the only player alive because the business has become so low-margin that everyone else has abandoned it intentionally.

That Silicon Valley pitch you are echoing rarely works out as advertised, even for the winners.

[aurareturn]

  We have seen plenty of examples in other industries where you can never really stop investing a ton on R&D with diminishing returns (like in semiconductors or pharma), because the moment you stop newcomers overtake you.

In semiconductors, it almost always become a monopoly or dupoly. x86 CPUs - only AMD and Intel left. Discrete gaming GPUs - only Nvidia and AMD left. 5G chips - only Qualcomm left in western market but Apple is about to join the part. In advanced chip node - only TSMC but Samsung and Intel survive due to geopoltics.

I think you're proving my point. Eventually, R&D heavy industries almost always become a monopoly or duopoly. Small/losing players can't keep up and drop out or acquired.

[oersted]

Check their R&D expenditures and profit margins they are quite poor.

Their revenue has always been sustained by the fact that their technology needs to be constantly replaced because it keeps getting better. The moment it stops getting better, the replacement rates plummet and so do their revenues. It's also really not that hard to compete with them when they get complacent.

I'm not counting Nvidia because they don't produce semiconductors themselves, they are a different kind of business.

They are indeed an example of those that cater to consumers and/or build popular products based on foundational tech from others, like Apple or Sony, which do tend to be quite profitable.

But the actual deep-tech semiconductor firms? They may be critical to the world economy, but they don't actually make that much money comparatively. In many cases they are not real monopolies, it's just that no one else wanted to continue investing in a shitty business model. Only the likes of TSMC and Samsung were okay in playing the low-margin game, but most US players left the board.

I believe AI has a lot of the same characteristics.