Hacker News new | ask | show | jobs
by profsummergig 170 days ago
Question:

Can a model's weights be hard-coded into a physical chip for cheap fast local AI?

1 comments

Not cheap, unless that one specific model is going to be used across tens of millions of devices, with no updates, for the physical lifetime of the device.
Ah, that makes sense. Economies of scale. Thanks.