[varunshenoy]

Thanks!

vLLM for quick set up, TRT-LLM for best performance. Both available on https://baseten.co/.