[ilaksh]

Yes I assume some kind of LLM system will eventually make its way into OS package registries and eventually there will be a standard of some sort. Already OpenAI's API is the de facto standard available from all providers. But who knows what port it's on. Maybe implement mDNS/DNS-SD or SSDP, and if not there it could just go through default ports like the Ollama one and check for a certain endpoint.