Hacker News new | ask | show | jobs
by jxf 293 days ago
As someone who is operating an enterprise platform that uses vLLM in the stack, it's immensely harder than "pip install vllm" to have it working at scale and kept up to date.