Hacker News new | ask | show | jobs
by ummonk 1280 days ago
How is hosting the knowledge in a large cloud database any different than hosting the model itself in the cloud? Why the need to run "reasoning" locally?
1 comments

You could have a locally trained variant that uses a tuned model or set of models, plus local data