Y
Hacker News
new
|
ask
|
show
|
jobs
by
liuliu
18 days ago
You also need to pay close attention to BFCLv3 multi-turn result, that helps you to get a sense how frequently these quants will be in a doom loop.
1 comments
h14h
18 days ago
I'm curious what kind of results one could get from combining the clever quantization PrismML is doing here with something like LiquidAI's antidoom:
https://github.com/Liquid4All/antidoom
link
https://github.com/Liquid4All/antidoom