Hacker News new | ask | show | jobs
by aurareturn 847 days ago
AI is going to drive huge demand for new silicon for inference mostly but also for training. Every device needs to have new processors that are optimized for running ML. For example, when the new iPhones integrate LLMs directly onto iPhones, you'll need to keep buying new iPhones because Apple will drastically increase the size of Neural Engine every generation.

AI is going to cause a huge uplift in chip demand from clouds to small devices.
1 comments
martin_drapeau 847 days ago
Hmm. For iPhones and Android, Apple and Samsung already have that covered. Their AI chips already exist and production must already be planned for the coming years. NVIDIA isn't going to contribute.

I heard predictions for increase in AI PC sales but I don't buy it. That remains to be proven.

So we are left with data centers. Isn't that right?

link
aurareturn 845 days ago
They need to drastically increase the size of the NPU every year to keep up. We are a long way away from running GPT4 on an iPhone.

Every chip will eventually need to be replaced with one that can do inference for a massive AI model. And we will need more chips to put in more places.

link