|
|
|
|
|
by _yid9
1218 days ago
|
|
The great thing about the current-gen LLMs — anybody will be able to run one on the next gen of hardware. We’re within one order of magnitude of the capacity right now on retail hardware. The moment of transition from “data-centric” (big centralized system/database) to “agent-centric” (locally stored/run systems and identity, sharing arbitrary data/storage) has arrived. GDPR, LLM “guard rails”, … — only the plebs will be affected by those. |
|
I agree. Use cases such as LLMs-as-backend-of-my-web-stack will move a lot of compute back to the edge of the network, eventually.