Hacker News new | ask | show | jobs
by parasubvert 39 days ago
Generally speaking, that's incorrect. That's like saying "I don't like cars, and don't see the value in cars, therefore the market for cars is fraudulent".

In AI, buyers are getting what they want. The demand is real. YOU might not value what they're getting, but that doesn't make it fraudulent.

This is why people misunderstand why AI isn't a bubble. A bubble is asset prices rising due to speculative demand far beyond what the actual demand is.

AI - specifically chip and memory markets feeding AI - is a demand shock on par with World War 2 in its impact. NVIDIA is legitimately forecasting demand of $1 trillion in their chips+memory by the end of 2027.

This is actual, real, shipping physical product: not vapor, not something that will disappear, not something that will "crash" suddenly.

Yes, there is some speculation among AI providers training new models in the race to AGI, but that is not the majority of demand, inference is 65-80% of demand. If the current pace of training slows, that excess capacity for training will get easily sorted out through resale markets.

The world has changed.

3 comments

There are circular deals, the product is heavily subsidized. Managers are promised the moon and are deceived about the actual capabilities of the product.

Mythos is marketed like a nuclear weapon to make people jealous.

AI model government approval is floated, perhaps in preparation for a government bailout justified by "national security".

Kushners are invested in OpenAI.

There is a lot of fraud going on.

> This is actual, real, shipping physical product: not vapor, not something that will disappear, not something that will "crash" suddenly.

"Not X, not Y, not Z, just A" works better than "Actually A, not X, not Y, not Z".

> Generally speaking, that's incorrect. That's like saying "I don't like cars, and don't see the value in cars, therefore the market for cars is fraudulent".

It's arguable that the car market is indeed fraudulent and the result of years of lobbying, destroying public transportation and car-centric architectures.

I tend to agree with you there, but that's not mostly due to an individual's (or group's) like or dislike of cars as a product.
> This is actual, real, shipping physical product: not vapor, not something that will disappear, not something that will "crash" suddenly.

Tulips were real shipping physical products. Railways were real. Housing was real. Whether or not the demand is speculative is largely disconnected from the actual subject of the bubble.

> NVIDIA is legitimately forecasting demand of $1 trillion in their chips+memory by the end of 2027.

Forecasts do not make it so.

> but that is not the majority of demand, inference is 65-80% of demand.

Inference is massively subsidized. The demand is fictitious just because of that. Once prices go up, especially once free or cheap inference dries up, demand will collapse.

But it's not even just the subsidies. AI is forced onto the workplace top-down. Executives demand AI be used before careful evaluation. That's all demand that can collapse at any moment if public opinion sours.

> The world has changed.

It hasn't. For all the claims that AI has made any given job so much easier, developers who claim "It'd have cost me a billion years to do so" (next time bring a counterfactual), the actual economic benefit appears to be a big fat zero. We're right back to the Solow paradox.

Except AI companies are dumping trillions of dollars into this, expecting tens of trillions in return ... from where? Where will these tens of trillions come from if the aggregate economic benefit doesn't exist? Joe Slopman making a dozen CRUD apps a week for half a million in revenue, but there ain't a million of him.

So much of the demand for inference is driven by hype. Companies using AI in the expectation of an ROI that has not materialized, and in many places, is very unlikely to. In no small part because any "efficiency" or "productivity" gains realized by AI immediately drives down the cost of the good or service produced.

Christ, I could kiss you right now.

Thank you for being one much needed voice of reason in this hellscape of AI buffoons that’s become of HN.

I had a long response to him; I don't think it's reasonable to believe that AI inference demand is going to suddenly collapse, and it would be wise to understand why.
> Tulips were real shipping physical products. Railways were real. Housing was real. Whether or not the demand is speculative is largely disconnected from the actual subject of the bubble.

I think this is definitionally wrong, but okay. We're talking about the price of supply chain components, not assets or speculative commodities. Tulip valuations were entirely driven by speculation. Housing bubbles are largely driven by speculation with cheap credit. Railway mania was about a stock market bubble, not the price of rail itself.

> Forecasts do not make it so.

In publicly traded companies, they tend to be accurate. Are you suggesting that NVIDIA has given improper forward guidance and is about to be subject to major shareholder lawsuits? That's a major short sell opportunity, and I suggest you get on that!

> Inference is massively subsidized. The demand is fictitious just because of that. Once prices go up, especially once free or cheap inference dries up, demand will collapse.

This is, kindly, incredibly wishful thinking. It may be true for individual companies that are stretching themselves too thin. On the other hand, Anthropic claims they are not subsidizing inference (they have raised prices - it hasn't slowed demand) and will become profitable around 2028 as training costs for LLMs have likely peaked. We'll see.

> It hasn't. For all the claims that AI has made any given job so much easier, developers who claim "It'd have cost me a billion years to do so" (next time bring a counterfactual), the actual economic benefit appears to be a big fat zero. We're right back to the Solow paradox.

... I think you may misunderstand the Solow paradox. Paul Strassmann's work on information productivity and "The Squandered Computer" covers a lot of this: there is no correlation between IT investment and productivity or profitability on the firm level, and a serious lag in overall productivity statistics until the 90s, because such gains are only achievable through alignment to meaningful business goals and structural change on processes. It's only when impactful practices become ubiquitous that they reflect in the statistics. The same will be for AI. Which is why I don't think that AI will be as fast an economic transformation as its proponents believe. But it will take place, unevenly to start.

> So much of the demand for inference is driven by hype.

We agree there.

> Companies using AI in the expectation of an ROI that has not materialized, and in many places, is very unlikely to.

We agree there too.

> Where will these tens of trillions come from if the aggregate economic benefit doesn't exist? Joe Slopman making a dozen CRUD apps a week for half a million in revenue, but there ain't a million of him.

Compressed project capital requirements and schedules, and compressed operational expenditure & time for many business processes. I've seen this myself before AI, 25+ years ago, with business process management and enterprise resource planning - think Peoplesoft, SAP, etc., replacing armies of paperwork processors. Same for accounting systems in the 60s and 70s.

Another area I have deep familiarity with - "precision railroading" pioneered by Hunter Harrison (a mix of locomotive distributed power technology, classification yard technology, IT systems, lean thinking, and management insight) has led to the most effective freight delivery times we've seen and productivity gains that many thought would be impossible (operating ratios in the sub-60s at times). This took decades to tweak and "get right" and is still subject to to many problems (safety issues, crew stress, and reliability delays to smaller customers due to a lack of slack in the system).

Of course, it takes insight, discipline, and design to extract technological gains on an individual firm or agency basis, which is why this stuff doesn't show up in the aggregate statistics until many years afterwards. Business intelligence systems also improved production and market decision making in the 90s and 00's, but that's hard to trace back to IT improvements.

I think with AI it is another round of major IT improvements in industries that were previously less susceptible to such change, and as such it will definitely be a multi-trillion dollar impact. But... It will be a mixed bag for a while - much longer than the AI CEOs would have you believe. I don't think this will lead to a crash, but I do think component shortages will eventually end (towards 2028-2029). Some will find significant benefits with it through expressive prompting, appropriate agent structure & guardrails, and deep contexts... and it will take a while for that know-how to spread.

> In no small part because any "efficiency" or "productivity" gains realized by AI immediately drives down the cost of the good or service produced.

I think there's significant lag on that point.