Hacker News new | ask | show | jobs
by ndgold 194 days ago
Lovely, yoinked.

Also, I’m seeing check marks next to all quants which confused me a little bit when trying to select.

1 comments

Thanks! I added the check marks because when I was testing different quantizations, I often picked a model and only afterwards discovered that it couldn’t even load — it just didn’t fit into RAM or VRAM.

So the check mark simply indicates that the model can actually run under those constraints (fits in memory), not that it’s selected.