Hacker News new | ask | show | jobs
by eclectic29 867 days ago
If you’re serious about production deployments vLLM is the best open source product out there. (I’m not affiliated with it)