Hacker News new | ask | show | jobs
by gtirloni 846 days ago
None. Microsoft has Copilot in preview mode in Windows and it's not very integrated apart from a chat window. I doubt GNOME/KDE will be able to dedicate enough resources to adding an assistant that is well integrated with the desktop environment any time soon.

A search in Fedora yields a single GSoC project[0] limited in scope to NetworkManager and it's not clear if anyone actually is working on that.

If the use case you're interested in is actually having the LLM doing things for you in SaaS applications, that wouldn't need deep integration but, considering Google is yet to deliver a Google Drive client for Linux, I wouldn't hold my breath waiting for a native Linux AI-assisted assistant.

Your best option right now is to interface with the assistants through their web interface and hope they have plugins/extensions to interact with things you want.

Other than that, some people have built prototypes running LLMs locally that talk to things like Home Assistant. But again, no deep desktop integration.

0 - https://docs.fedoraproject.org/en-US/mentored-projects/gsoc/...

3 comments

Given the fact that one can control damned near everything over command line in linux, and command line is a much more stable interface than a gui, I'd guess that there's a great deal more potential for assistants in linux than windows.

The other day I wanted to figure out how to turn my dock red if I dropped the vpn in gnome. I found the file that controlled my wireguard gnome shell extension and with the help of gpt3.5 and some very rudimentary js knowledge (I'm a backend dev, don't hate me), I was able to add a js function to toggle the color on vpn up / down events. This didn't even take me an hour to do and I'd never even thought to try it before GPT.

Sure, things are janky now, but the future potential of LLMs with linux and OSS is huge.

Recently came across https://www.warp.dev/ on HN, which includes a AI part for your terminal. That's a paid feature running nonlocal, but it's a start I suppose.
"I wouldn't hold my breath waiting for a native Linux AI-assisted assistant"

A simple chat window and a automated script to install a existing small modell should be doable, but sounds not very exciting to me.

But mid term, having a locally run LLM and integrated into the OS that scans my files and can summarize folders for me, would be nice. I have big folders with mixed stuff, AI would be nice to sort that. I do believe some people are working on something like this, but the bulk of it is not OS specific. And not OSS.

> But mid term, having a locally run LLM and integrated into the OS that scans my files and can summarize folders for me

But don't most LLMs have about a max 32k token context?

The idea is to have a personal AI, that is trained with my content, my files. My emails, my pictures, projects, notes, etc. How that can be implemented in the best way, is not my expertize, but I believe is subject of heavy research.
>scans my files and can summarize folders for me

Can you tell me what exactly you want it to do? You have a bunch of files in folders and you want the AI to tell you what exactly?

Not OP, but when searching for files, spelling something wrong, or using the wrong synonym is a big problem. We're just used to computers being inflexible.
I mean, I see, but do you need an entire AI for this? This sounds like a specific problem that would be best solved by a specific algorithm.
You can use fzf for this
Do you mean to say that fzf can find synonyms?
"You have a bunch of files in folders and you want the AI to tell you what exactly?"

For example: "show me the folder(s), where my old University projects are stored"

"Sort this folder into programming projects, general notes, pictures, music, videos and install files"

"Find me the folder where I made notes about a novel sorting algorithm"

It sounds like you want... folders. Genuinely. Or a tag system. Or some other metadata.

Like, take this query for example: show me the folder(s), where my old University projects are stored. How would an AI, however powerful, know what are "university projects" if they aren't tagged as such? And if they were, why is the AI necessary?

One approach I've tried before is: if you have a folder /projects/ with so many project folders in it that you don't even know anymore what is what anymore, you just create a text file called /projects/index.txt and write the name of each folder in there and what it's for, so you don't forget later.

Well, but they ain't tagged or sorted. And an AI could know, because of the context. If it knew what year I studied and what courses etc then this information would be enough to separate content. But I am aware, that this tech ain't there yet.
> I wouldn't hold my breath waiting for a native Linux AI-assisted assistant.

On Mac when I press Command + Space, it brings up Spotlight search

That can't easily be added to be the equivalent of some kind of LLM prompt on GNOME/KDE/XFCE?

I don't quite know what you'd ask it/do with it that would be of much value? Seems like a quicker way/a wrapper around either asking an LLM questions via CLI or basically Electron wrapping HTML (like this https://github.com/lencx/ChatGPT)?

> That can't easily be added to be the equivalent of some kind of LLM prompt on GNOME/KDE/XFCE?

Both GNOME and KDE have that already. Shouldn't be too hard to implement what you're thinking if the APIs/services are available.

Or wrap to a shell script if the LLM has a local "CLI" interface, right?