Y
Hacker News
new
|
ask
|
show
|
jobs
by
unglaublich
19 days ago
So I guess we'll all be applying a random rotation to our matrices now to obscure their contents, like TurboQuant does.
https://arkaung.github.io/interactive-turboquant/#rotation
1 comments
buildbot
19 days ago
Not that it super matters, but random hadamards for quantization have been a thing since way before turboquant.
https://arxiv.org/abs/2404.00456
link
DiabloD3
19 days ago
Which llama.cpp now does.
link
https://arxiv.org/abs/2404.00456