Hacker News new | ask | show | jobs
by bigdict 444 days ago
Amazing, I've been wishing for this! Do you have any estimates on how much accuracy is first lost then recovered compared to the original bf16 and the naively quantized models?