MLC LLM: Universal LLM Deployment with GPU Acceleration | HN Mirror

Y	Hacker News new \| ask \| show \| jobs

	MLC LLM: Universal LLM Deployment with GPU Acceleration (github.com)
	3 points by crowwork 1147 days ago

1 comments

crowwork 1147 days ago

Supported platforms include:

- Metal GPUs on iPhone and Intel/ARM MacBooks

- AMD and NVIDIA GPUs via Vulkan on Windows and Linux

- NVIDIA GPUs via CUDA on Windows and Linux

- WebGPU on browsers (through companion project WebLLM).