Is this admission that google’s proprietary chips etc. are not cutting it? Why would you need a bunch of nvidia GPUs if you have your own silicon? (AFAIK they have their own for both inference and training do they not?)
How do you come to this conclusion? All it means is that spacex has compute and google does not.
Suppose tpus were theoretically a million times better, but cannot be produced due to supply chain constraints, this action would still be rational.
My personal take is that this really shows how bottlenecked the entire supply chain is. For such an important commodity there are shockingly few players ready for scale.
3 years is quite a short horizon when it comes to semiconductor fabs. Also this article is a dupe, when it was previously discussed it surfaced that after some time either party can cancel with only 90 days notice.
Kinda; while it does show that overall Google's proprietary chips etc. are not cutting it, it doesn't say if the problem is the hardware itself or the factories to make more of the hardware. Without more information, it could be that Google's hardware is 100x the energy efficiency per token, but they can only make enough hardware for 1% of the tokens there's currently demand for: 1% of your product being 0.01% of your costs isn't nothing, but it leaves the other 99% at full price.
Its because none of the promised Data Center and NVIDIA hardware deployments described in NVDA earnings calls have actually happened. Once more Ed Zitron has the goods: https://youtu.be/zbKDmkJPVvI?t=482
Supply and demand? Bubblists seem to think there's an infinite supply of chips, power, and water to make as many chat bots as possible; physics, as usual, dictates limits.
Or alternatively there is simply a huge demand for compute and this is helping them fill a short-term need. Keep in mind if you saw in the article there is a 90-day cancellation clause. This is a nothing burger.
I don't think so. It provides some nice optionality for Google and I am guessing this opportunity only exists because Grok is not popular and xAI does not really have any other use atm.
Suppose tpus were theoretically a million times better, but cannot be produced due to supply chain constraints, this action would still be rational.
My personal take is that this really shows how bottlenecked the entire supply chain is. For such an important commodity there are shockingly few players ready for scale.