Hacker News new | ask | show | jobs
by trouve_search 1 day ago
gemma 12B 4bit quant; try something with MTP and an AWQ quant