vLLM 在 AgentX 上跑 DeepSeek V4.1 Flash：954K tok/s/GPU

vLLM @vllm_project原推发布于 2026.10.25

在 X 上打开原推

Beyond matching DeepInfer's performance, we also put vLLM to the test on @SemiAnalysis_ AgentX with real-world agentic workloads. At DeepSeek's off-peak pricing, vLLM delivers $38.96/GPU-hour revenue, with 954K tokens/s/GPU total throughput (cached+input+output) at 196 tokens/s P90 per user. This is the best DeepSeek-V4.1-Flash result on AgentX ever, powered by recent advancement in vLLM! Check out our blog for the full optimization story and how to reproduce the results 👇 Enjoy the read.

这条是引用着另一条写的：「vLLM 在 GB300 NVL72 上服务 V4.1 Flash：单 GPU 954K tok/s」