Hacker News new | ask | show | jobs
by charcircuit 11 days ago
Along with everything else. These parameters can make speculative decoding less accurate increasing the inference cost.