Hacker News new | ask | show | jobs
by salter2 46 days ago
Perhaps something similar to speculative decoding.

Speculating Experts Accelerates Inference for Mixture-of-Experts: https://arxiv.org/abs/2603.19289