Hacker News new | ask | show | jobs
by rsoto2 26 days ago
Uhh I think a lot of people and their families likely have investment exposure to nvidia/hyperscalers. if places like Amazon spent unrealistically on ai or their stock goes down massively that could mean major job losses too.

If AI companies aren't that profitable...then they're going to stop spending so much money on GPUs to train AI models. A gigantic amount of Nvidia's profits would go bust overnight.

1 comments

But inference is increasing dramatically. Google says they now do inference of 3.2 quadrillion tokens per month, 7x increase in a year.

Claude code and others are here to grow even if they don't do any further training.

.. so what?

The cost(and size) to train models is also increasing and is still 60% of the cards that Nvidia is selling. Losing 60% of your most profitable revenue stream I think would do bad for a company regardless of how much inference is increasing "dramatically"(all this means is the GPUs are dead sooner and the cost to do this massive inference increases too)