Hacker News new | ask | show | jobs
by moffkalast 975 days ago
I think you're still missing AWQ ones, which are a sort of GPTQ but with dynamic quantization depending on weight importance iirc?