|
|
|
|
|
|
by girvo
23 hours ago
|
|
|
27B seems surprisingly resiliant to quantisation. Though my evals showed there was some impact to coding ability from 8 bit to 4 bit, it was less than I would've expected: and it was on task types that you've said above that you don't really do with these! |
|
|