Hacker News new | ask | show | jobs
by nulledy 15 days ago
The Qwen models seem to be the best currently in my experience.

But if you're thinking about buying new hardware just for local inference: don't.

You'll spend more upfront for rapidly out of date and depreciating hardware while running inferior models compared to the latest from Anthropic and OpenAI.

Unless your requirement is prompt privacy, or you have idle hardware sitting around, the ROI just isn't there compared to a monthly subscription.