Simple LLM VRAM calculator for model inference

Y	Hacker News new \| ask \| show \| jobs

	Simple LLM VRAM calculator for model inference (bestgpusforai.com)
	2 points by javaeeeee 302 days ago

1 comments

javaeeeee 302 days ago

This calculator estimates the GPU memory needed to run LLM inference. Select the model size and precision (FP32 - FP4) to get a quick memory range estimate.

link