|
|
|
|
|
|
by justsid
398 days ago
|
|
|
I have found that even 2 bit quantization works, but you have to make sure you only discard the LABs (that’s what we are calling the Left Aligned Bits internally). I have no idea why it works so well but it has cut our costs significantly. |
|
|