Hacker News new | ask | show | jobs
by briancleland 936 days ago
Sounds like speculative decoding.

https://huggingface.co/blog/vivien/optimal-lossy-variant-of-...