Hacker News new | ask | show | jobs
by _yid9 1218 days ago
The great thing about the current-gen LLMs — anybody will be able to run one on the next gen of hardware. We’re within one order of magnitude of the capacity right now on retail hardware.

The moment of transition from “data-centric” (big centralized system/database) to “agent-centric” (locally stored/run systems and identity, sharing arbitrary data/storage) has arrived.

GDPR, LLM “guard rails”, … — only the plebs will be affected by those.

2 comments

> The moment of transition from “data-centric” (big centralized system/database) to “agent-centric” (locally stored/run systems and identity, sharing arbitrary data/storage) has arrived.

I agree. Use cases such as LLMs-as-backend-of-my-web-stack will move a lot of compute back to the edge of the network, eventually.

I believe you could run GPT-2 at home now.

Remember when OpenAI claimed that was too much power to allow open access to?

Benevolent overlords patting the filthy masses on the head.