Hacker News new | ask | show | jobs
by fzysingularity 481 days ago
We’re adding this as we speak. Ollama support is already there, and here’s vLLM inference: https://github.com/vlm-run/vlmrun-hub/pull/120