Hacker News new | ask | show | jobs
by roger_ 16 days ago
Does this support Qwen 3.6 (e.g. 27B) and the myriad of llama.cpp options (batch sizes, quantization, etc.)?

I'd love to see some performance data.

1 comments

Yes! I’ve worked on the settings interface between our runtime and llamacpp, these are documented and available via our config.toml file