Hacker News new | ask | show | jobs
A simple L7 proxy for vLLM that manages LoRA adapter storage via NVMes (github.com)
2 points by shayonj 103 days ago