Y
Hacker News
new
|
ask
|
show
|
jobs
by
krzyk
44 days ago
AFAIR the general consensus is (was?): - llama.cpp for single user - vLLM for multi-user (e.g. enterprises)
They are similar, but for different use cases.