Hacker News new | ask | show | jobs
by DrJosiah 1180 days ago
It might have been a typo, as the current llama.cpp / alpaca.cpp included quantizers default to 4 bits.