[anonzzzies]

Does it do queuing ? Didn’t see it in the readme. I haven’t seen (but that says nothing at all) an open source solution that queues when all are busy and allow me to show a countdown of people in the queue. Like the closed ones do.

[ritonlajoie]

I stumbled on this yesterday, it seems to have a queue concept.. https://github.com/ParisNeo/ollama_proxy_server

[mcharytoniuk]

In progress. I added that to the readme; I need the feature myself. :)

[friendly_chap]

I have actually open sourced one recently which supports queues - its both a desktop app and a daemon: https://github.com/singulatron/singulatron

[3abiton]

So many interesting projects, I just wish AI hardware was readily available.