vLLM 在 GB300 NVL72 上服务 V4.1 Flash：单 GPU 954K tok/s
vLLM 用 P/D 分离与 Wide-EP 在 GB300 NVL72 机架部署 V4.1-Flash，SemiAnalysis AgentX 上每 GPU 达 954K tokens/s、单用户 P90 196 tokens/s，为单节点结果的 7.9 倍。
Scaled out with P/D disaggregation and Wide-EP on a GB300 NVL72 rack, vLLM serves V4.1-Flash on SemiAnalysis AgentX at 954K tokens/s per GPU with 196 tokens/s P90 per user, 7.9× our single-node result. Our engineering blog covers the work behind it: https://vllm.ai/blog/2026-10-23-deepseek-v41-flash-pd-wide-ep
vLLM matches DeepInfer, DeepSeek's own engine for DeepSeek-V4.1-Flash, on DeepSeek's decode configuration across batch sizes 8 to 256, and does it at DEP32 against DeepInfer’s EP64DP64. DeepInfer was originally built on vLLM. By integrating DeepSeek's open-source kernels and extensively optimizing prefill and decode, vLLM now matches DeepInfer's performance curves.
