Hacker News new | ask | show | jobs
by nacs 1095 days ago
GPTQ support would be amazing (AutoGPTQ is an easy way to integrate GPTQ support - it's basically just importing autogptq and switching out 1 line in the model loading code).