Y
Hacker News
new
|
ask
|
show
|
jobs
by
mycall
147 days ago
You can get concurrency gains [0] as local/single user (multi-agent) use case with vLLM with your Mac Studio.
[0]
https://youtu.be/Ze5XLooTt6g?t=658