Y
Hacker News
new
|
ask
|
show
|
jobs
by
woadwarrior01
26 days ago
> some providers will ride on the good reputation of some local model, selling you a terrible quant instead.
Quants in popular local inference apps (Ollama, LM Studio, etc) are the worst possible quants (RTN).