Hacker News new | ask | show | jobs
by wren6991 40 days ago
I also have a script to find the best LLM for your hardware. Here:

echo "Qwen3.6-27B"

2 comments

works awesome, and it picked the best model for my machine, Qwen3.6-27B...

For next version can you add install as well ;)

What about for 16 GB VRAM? Is Qwen3.5-9B worthwhile?
For 16 GB I would look into running Qwen3.6-35B-A3B (MoE) with some layers offloaded to CPU.