Hacker News new | ask | show | jobs
by krzyk 44 days ago
AFAIR the general consensus is (was?): - llama.cpp for single user - vLLM for multi-user (e.g. enterprises)

They are similar, but for different use cases.