MiniMax M3.1 Flash on two DGX Sparks: 29.4 tok/s on code, about a third of DeepSeek
On a TP=2 Spark setup M3.1 Flash gets 29.4 tok/s on code and 27.8 on tool calls at 131K context, versus roughly 90 for DeepSeek, because it reads about 7.7 GB per token against DeepSeek's 3.8 GB.
This one feels a bit disappointing, honestly. @MiniMax_AI MiniMax-M3.1-Flash on two DGX Sparks ALPHA: 29.4 tok/s on code 27.8 on tool calls 131K context. My DeepSeek recipe does ~90 on the same TP=2 setup. MiniMax reads about 2x the bytes per token, and Spark decode is bandwidth-bound. Built on @MiaAI_lab's MiniMax-M3.1 TensorFold patch and @ashxhart TensorFold. Model and DSpark drafter by MiniMax. Decoding on a Spark is bandwidth-bound, so speed comes down to bytes read per token. MiniMax has ~24.7B active params, 64 attention heads at 8,192 wide and a big shared expert, all running on every token. ~7.7 GB per Spark per token. DeepSeek Flash is ~16B active and ~3.8 GB. I suggest a 2100-2200 MHz GPU clock cap, as I noticed it approaching heat cutoff at times. I am working on a performance pass right now and more cache work, but at the current speed and context, it's hard to justify using it. Early indicators show a potential 30% increase, but ultimately a smaller quant will be needed to get any speed. Recipe and weights in the reply. What would you run on it?