Y
Hacker News
new
|
ask
|
show
|
jobs
by
charcircuit
11 days ago
Along with everything else. These parameters can make speculative decoding less accurate increasing the inference cost.