Y
Hacker News
new
|
ask
|
show
|
jobs
by
garyfirestorm
379 days ago
Run a vllm docker container. Yeah the assumption is you already know what hardware you need or you already have it on prem. Assuming this is ITAR stuff, you must be self hosting everything.