Hacker News new | ask | show | jobs
by dragonwriter 1153 days ago
Quantization is reducing the precision (and size) of values.

https://huggingface.co/docs/optimum/concept_guides/quantizat...