Hacker News new | ask | show | jobs
by apitman 313 days ago
Did you test multi-user cases?
1 comments
jasonjmcghee 313 days ago
Assuming this is equivalent to parallel sessions, I would hope so, this is like the entire point of vLLM
link