|
|
|
|
|
|
by zhisbug
1166 days ago
|
|
|
My point is that I am not aware of any official 4-bit quantization version (delta or weights) by lmsys so it might too early to draw your conclusion that vicuna finetuned llamas degenerates a lot of performance at 4 bit but others are fine. |
|
|