Y
Hacker News
new
|
ask
|
show
|
jobs
by
wkat4242
805 days ago
I wonder, can you quantize it yourself with some tool?
1 comments
pja
805 days ago
llama.cpp can quantize a model for you:
https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#qu...
link
wkat4242
805 days ago
Thanks!!
link
https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#qu...