Y
Hacker News
new
|
ask
|
show
|
jobs
by
p_stuart82
17 days ago
Does this catch intermittent fallback between requests?
1 comments
logickkk1
17 days ago
Yes, picchio monitors a running llama-server on a timer and flags when the prefill/decode ratio goes CPU-shaped. I hot-swapped one mid-run. probe 4 caught ENGAGED -> NOT ENGAGED.
link