Hacker News new | ask | show | jobs
by david_shi 8 days ago
If you burn a model to a chip what happens if there's a better model?
4 comments

You have a slightly less great model. Depending on your thesis on how fast AI will advance, that might be minimal, or it might be huge. However, "AI is advancing too fast for people to make obvious efficiency improvements economically worth doing" is rather hard to square with "AI is a lie and will never generate profits."
They will come with corrective SSD and Ram that will enable stale models to get some amount of self correction. Then after that it will be a typical upgrade path. Actually a nice business model with upgrades built in.
Same thing we do now given chips that do not have an OS and apps built in... write them to storage and load them into volatile memory at runtime.
I had the same question.

I wondered if it'd be possible to use a rewritable chip or a socketed chip...

Not sure about sockets but I've seen a company with a wafer sized TPU thing or whatever. They claim to have an approach to route around the defects and I had to scroll past some press release I didn't read about the stock market, so someone believes in them I guess. They sell a mini-fridge that can handle a model with trillions of parameters with a contact sales button. Cerberas is their name. I actually ended up misremembering the name name of Taalas as Cerberas and discovered them when I was researching the above comment. Taalas burns models to chips. Cerberas makes pizza sized chips.