SGLang ships day-0 support for MiniMax M3.1 Flash (Space Bunny): >1K tok/s single-request decode
SGLang adds day-0 serving for the open weights: over 1K tok/s at batch size 1, ~100K tok/s per GPU on the AgentX coding trace with 96 concurrent sessions, on Blackwell/Hopper and AMD MI350X.
Space Bunny is here! 🐰 MiniMax M3.1 Flash hits >1K tok/s, bs1 decode with SGLang, production-ready from Day 0. This integration is a joint effort by @MiniMax_AI, @NVIDIAAI, @AMD, and @radixark, and you can also run RL with Miles! -Broad hardware support: NVIDIA Blackwell and Hopper (GB300/B300/B200/H200), plus AMD Instinct MI350X and MI355X. -Agentic serving at scale: ~100K total tok/s per GPU on the AgentX coding-agent trace with 96 concurrent sessions. -Speculative decoding: Supports MiniMax's DSpark draft and a DFlash2 draft trained by @radixark; supports HiCache and multimodal input. -Ultra-low-latency inference: MegaKernels deliver 2.15× faster single-request decode.
This post quotes another post: “MiniMax M3.1 Flash open weights: 428B total, 23B activated”