Hacker News new | ask | show | jobs
by b112 28 days ago
Well there's only one reason, so you do indeed know why.

Here's the thing, by 2028, maybe 2029, 1/2 the cloud AI providers are going to go bankrupt, or severely downsize. This will likely be due to massive reduced power and processor requirements for AI. GPUs are a stopgap, and they won't be used much longer. When that happens, and the number of servers drops by 90%, along with similar power requirements, a lot of people are going to go tits up due to massive, empty datacentres and compute.

That will absolutely flood the market with cheap obsolete GPU + RAM, used servers, you name it. Current RAM prices will plummet, and those able to withstand the storm will have to compete again, not just ride the wave like they've been doing now.

RAM has been ridiculously high for a long time, it won't be by 2030.

Couple that with local SoC with dedicated compute for LLMs, and you have the perfect storm for local, on phone compute. Why this? Well, because LLMs will be in everything! Certainly in robots, autonomous weapons, and anything the crazies can shove it into. Phones won't be the unique case, it'll be sharing a hardware market with robots, and 100 other things using the same SoCs.

Local compute will be easy... RAM makes a massive difference, huge as you know, difference in local compute. And with the datacentre market in tatters, and people becoming more and more concerned about privacy, people will likely not want to whisper to a cloud LLM, about their fetishes for donkeys or moose or whatever turns their crank.

Not to mention, other aspects of their lives.

In as RAM will be super cheap, that's where I see this going.

I have a sneaking suspicion you don't agree with this assessment. I guess we'll come back here 2030 and see what's what.

1 comments

What do you think the production cost of RAM is? Even if we perfectly fixed competition and ended the AI bubble right now, I don't see how new RAM prices would drop below half the previous low point by 2030. Those fabs are legitimately ultra expensive, that's why almost all the RAM makers went out of business and we're left with the current cartel.

Also "massively reduced requirements for AI, so much so that we have 90% fewer servers despite the Jevons paradox" is not compatible with "high quality models make effective use of terabytes of memory" and "LLMs will be in everything".

And even if you could perfectly reuse all the memory out of the collapsing datacenters, that's not enough to make many of the phones and laptops you're describing. We'd need a 10x increase in manufacturing on top of the massive price drops, and even if we started building those fabs today they wouldn't be done in time (and we wouldn't have enough equipment to fill them).