Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Perhaps something similar to speculative decoding.

Speculating Experts Accelerates Inference for Mixture-of-Experts: https://arxiv.org/abs/2603.19289



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: