Hacker News new | ask | show | jobs
by rsoto2 15 days ago
.. so what?

The cost(and size) to train models is also increasing and is still 60% of the cards that Nvidia is selling. Losing 60% of your most profitable revenue stream I think would do bad for a company regardless of how much inference is increasing "dramatically"(all this means is the GPUs are dead sooner and the cost to do this massive inference increases too)