MiMo-V2.6 tops open-weight benchmark with a simple GQA and sliding-window design

Sebastian Raschka @rasbtOriginally posted 2026.09.22

Open original on X

MiMo-V2.6 is "simply" the best (for now). Despite its simple architecture design it's currently No.1 in the open-weight benchmarks (weighted average). With "simple," I mean a classic Grouped Query Attention (GQA) with Sliding Window Attention (SWA) at a tiny 128-token window https://t.co/A4xWU1eXlV https://t.co/sEWN1ictiw

This post quotes another post: x.com/i/web/status/2102128560962187701