Hacker News new | ask | show | jobs
by garyfirestorm 379 days ago
Run a vllm docker container. Yeah the assumption is you already know what hardware you need or you already have it on prem. Assuming this is ITAR stuff, you must be self hosting everything.