EAGLE-4 推理加速方案发布并开源

Soulful Ai @soulful__ai原推发布于 2026.10.21

在 X 上打开原推

Faster inference isn't just about generating tokens faster. The architecture driving that acceleration matters just as much. EAGLE-4 combines EAGLE-Harness, which adapts draft structures to hardware and workload conditions, with an Efficient LM Head that cuts draft-model overhead by over 40%. The results are impressive: 961.6 tokens/s for a single request and 4× the speed of vanilla decoding. The launch paper also reports strong throughput performance against DFlash 2 and DSpark. Explore the implementation: https://github.com/eagle-hq/EAGLE-4

这条是引用着另一条写的：x.com/eaglecorp/status/2112660683670323531