Hacker News new | ask | show | jobs
by hertzdog 194 days ago
Thanks! I added the check marks because when I was testing different quantizations, I often picked a model and only afterwards discovered that it couldn’t even load — it just didn’t fit into RAM or VRAM.

So the check mark simply indicates that the model can actually run under those constraints (fits in memory), not that it’s selected.