Hacker News new | ask | show | jobs
by Someone1234 13 hours ago
Many of us would love to, and the models are there, but we're constrained by heavily inflated hardware costs.

If big AI does crash out, it would be an absolute gold-mine for local LLM. Cheap, efficient, Nvidia GPUs, and RAM that can run the best local models already available, will be a real boon.

PS - And as great as Qwen3.6-27B is, how large you can scale it (i.e. how big of a context/project) is mostly hardware constrained.