Hacker News new | ask | show | jobs
by anonzzzies 748 days ago
Does it do queuing ? Didn’t see it in the readme. I haven’t seen (but that says nothing at all) an open source solution that queues when all are busy and allow me to show a countdown of people in the queue. Like the closed ones do.
3 comments

I stumbled on this yesterday, it seems to have a queue concept.. https://github.com/ParisNeo/ollama_proxy_server
In progress. I added that to the readme; I need the feature myself. :)
I have actually open sourced one recently which supports queues - its both a desktop app and a daemon: https://github.com/singulatron/singulatron
So many interesting projects, I just wish AI hardware was readily available.