Self-Host LLMs with VLLM and BentoML

Y	Hacker News new \| ask \| show \| jobs

	Self-Host LLMs with VLLM and BentoML (github.com)
	3 points by sherlockxu 788 days ago

1 comments

What are the hardware specs needed to run this?