[lukan]

"I wouldn't hold my breath waiting for a native Linux AI-assisted assistant"

A simple chat window and a automated script to install a existing small modell should be doable, but sounds not very exciting to me.

But mid term, having a locally run LLM and integrated into the OS that scans my files and can summarize folders for me, would be nice. I have big folders with mixed stuff, AI would be nice to sort that. I do believe some people are working on something like this, but the bulk of it is not OS specific. And not OSS.

[MuffinFlavored]

> But mid term, having a locally run LLM and integrated into the OS that scans my files and can summarize folders for me

But don't most LLMs have about a max 32k token context?

[lukan]

The idea is to have a personal AI, that is trained with my content, my files. My emails, my pictures, projects, notes, etc. How that can be implemented in the best way, is not my expertize, but I believe is subject of heavy research.

[AlienRobot]

>scans my files and can summarize folders for me

Can you tell me what exactly you want it to do? You have a bunch of files in folders and you want the AI to tell you what exactly?

[HKH2]

Not OP, but when searching for files, spelling something wrong, or using the wrong synonym is a big problem. We're just used to computers being inflexible.

[AlienRobot]

I mean, I see, but do you need an entire AI for this? This sounds like a specific problem that would be best solved by a specific algorithm.

[number6]

You can use fzf for this

[HKH2]

Do you mean to say that fzf can find synonyms?

[lukan]

"You have a bunch of files in folders and you want the AI to tell you what exactly?"

For example: "show me the folder(s), where my old University projects are stored"

"Sort this folder into programming projects, general notes, pictures, music, videos and install files"

"Find me the folder where I made notes about a novel sorting algorithm"

[AlienRobot]

It sounds like you want... folders. Genuinely. Or a tag system. Or some other metadata.

Like, take this query for example: show me the folder(s), where my old University projects are stored. How would an AI, however powerful, know what are "university projects" if they aren't tagged as such? And if they were, why is the AI necessary?

One approach I've tried before is: if you have a folder /projects/ with so many project folders in it that you don't even know anymore what is what anymore, you just create a text file called /projects/index.txt and write the name of each folder in there and what it's for, so you don't forget later.

[lukan]

Well, but they ain't tagged or sorted. And an AI could know, because of the context. If it knew what year I studied and what courses etc then this information would be enough to separate content. But I am aware, that this tech ain't there yet.