[ericb]

I would add an LLM like QwQ-32B to the mix--that has a ton of compressed knowledge embedded in it.

I would also store it in a steel Oscar the Grouch style trash can for a cheap faraday cage, which gets you protection from solar flares, and EMP blasts.

[int_19h]

LLMs are a bad deal when you look at how much power you need to run that inference. A device that could barely run one instance of QwQ-32B at glacial speeds will be able to serve multiple concurrent users of Kiwix.

[ForOldHack]

Quick question: which car companies are working on self driving cars? All of them, and two other companies ( Apple and Google ).

Which militaries are working on battle field AI. All of them.

Could a 64Gb dual xeon run say 50 to 100 users of kiwix?

[ericb]

To serve multiple users, probably not.

But--if you don't think of asking Hacker News every single thing you need to know beforehand, I think you still want the LLM to answer questions and help you bootstrap it.

[moffkalast]

Learning things from scratch is really hard too, just a copy of wikipedia gets one absolutely nowhere if you don't know what to search for.

Having something that you can plainly ask how to start that will point you in the right direction and explain the base concepts is worth a lot more, it turns raw data into genuine information. Yes it can be wrong sometimes, but so can human teachers and you can always verify, which is a good skill to practice in general.

[ForOldHack]

See the Wired article on the rewright of German history. And The George Galloway article. The enshitification has not only begun, it's in rising force.