Hacker News new | ask | show | jobs
by AlekseiSavin 338 days ago
right now, we support AWQ but are currently working on various quantization methods in https://github.com/trymirai/lalamo