Y
Hacker News
new
|
ask
|
show
|
jobs
by
roger_
16 days ago
Does this support Qwen 3.6 (e.g. 27B) and the myriad of llama.cpp options (batch sizes, quantization, etc.)?
I'd love to see some performance data.
1 comments
sig_kill
16 days ago
Yes! I’ve worked on the settings interface between our runtime and llamacpp, these are documented and available via our config.toml file
link