[ParetoOptimal]

> don't understand why anybody would run a "less-good" version locally

Privacy.

If you use llm's on private documents you don't want others to see, you'll likely prefer local models strongly.

[frankacter]

How would you, in LM Studio or another local option, populate with your own documents? I don't see any option of applying knowledge via pdf/doc/txt.

[ParetoOptimal]

https://github.com/imartinez/privateGPT

https://khoj.dev/