Hacker News new | ask | show | jobs
by quentinp 811 days ago
Actually they plan to put an LLM in your back pocket using flash memory, not silicon: https://arxiv.org/abs/2312.11514
1 comments

The flash doesn't do the computations though, that's just a method of getting it to the processor
It would be better to have eeprom or some such directly attached as memory. No loading.