Hacker News new | ask | show | jobs
by danielovichdk 844 days ago
No. Your own data only gets you so far. And this is exactly the issue. No local model will make sense because the dataset its given is so small compared to what you are referring to - chatgpt.

It's useless locally.

3 comments

I’ve been using 7b models to work with large text volumes (like entire books) with nothing short of phenomenal results. It has cut the time I need to accomplish many tasks by >90% and often offers insights I might easily have missed. My methodology requires a bit of time and compute to prepare a new subject matter expert system, but the results are absolutely worth it.
Would you care to share how you technically are doing this ? Please
If you only need to query your own data, and can't upload that data to ChatGPT for compliance/security reasons, I think local LLMs are far from useless.
I have been downvoted here which is fine. But no one took the time to elaborate on where i am wrong ? Tell me where i am wrong please.